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Preface 



The area of adaptive control has grown to be one of the richest in terms of 
algorithms, design techniques, analytical tools, and modifications. Several 
books and research monographs already exist on the topics of parameter 
estimation and adaptive control. 

Despite this rich literature, the field of adaptive control may easily appear 
to an outsider as a collection of unrelated tricks and modifications. Students 
are often overwhelmed and sometimes confused by the vast number of what 
appear to be unrelated designs and analytical methods achieving similar re- 
sults. Researchers concentrating on different approaches in adaptive control 
often find it difficult to relate their techniques with others without additional 
research efforts. 

The purpose of this book is to alleviate some of the confusion and diffi- 
culty in understanding the design, analysis, and robustness of a wide class 
of adaptive control for continuous-time plants. The book is the outcome of 
several years of research, whose main purpose was not to generate new re- 
sults, but rather unify, simplify, and present in a tutorial manner most of the 
existing techniques for designing and analyzing adaptive control systems. 

The book is written in a self-contained fashion to be used as a textbook 
on adaptive systems at the senior undergraduate, or first and second gradu- 
ate level. It is assumed that the reader is familiar with the materials taught 
in undergraduate courses on linear systems, differential equations, and auto- 
matic control. The book is also useful for an industrial audience where the 
interest is to implement adaptive control rather than analyze its stability 
properties. Tables with descriptions of adaptive control schemes presented 
in the book are meant to serve this audience. The personal computer floppy 
disk, included with the book, provides several examples of simple adaptive 
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control systems that will help the reader understand some of the implemen- 
tation aspects of adaptive systems. 

A significant part of the book, devoted to parameter estimation and 
learning in general, provides techniques and algorithms for on-line fitting 
of dynamic or static models to data generated by real systems. The tools 
for design and analysis presented in the book are very valuable in under- 
standing and analyzing similar parameter estimation problems that appear 
in neural networks, fuzzy systems, and other universal approximators. The 
book will be of great interest to the neural and fuzzy logic audience who 
will benefit from the strong similarity that exists between adaptive systems, 
whose stability properties are well established, and neural networks, fuzzy 
logic systems where stability and convergence issues are yet to be resolved. 

The book is organized as follows: Chapter 1 is used to introduce adap- 
tive control as a method for controlling plants with parametric uncertainty. 
It also provides some background and a brief history of the development 
of adaptive control. Chapter 2 presents a review of various plant model 
representations that are useful for parameter identification and control. A 
considerable number of stability results that are useful in analyzing and un- 
derstanding the properties of adaptive and nonlinear systems in general are 
presented in Chapter 3. Chapter 4 deals with the design and analysis of on- 
line parameter estimators or adaptive laws that form the backbone of every 
adaptive control scheme presented in the chapters to follow. The design of 
parameter identifiers and adaptive observers for stable plants is presented 
in Chapter 5. Chapter 6 is devoted to the design and analysis of a wide 
class of model reference adaptive controllers for minimum phase plants. The 
design of adaptive control for plants that are not necessarily minimum phase 
is presented in Chapter 7. These schemes are based on pole placement con- 
trol strategies and are referred to as adaptive pole placement control. While 
Chapters 4 through 7 deal with plant models that are free of disturbances, 
unmodeled dynamics and noise. Chapters 8 and 9 deal with the robustness 
issues in adaptive control when plant model uncertainties, such as bounded 
disturbances and unmodeled dynamics, are present. 

The book can be used in various ways. The reader who is familiar with 
stability and linear systems may start from Chapter 4. An introductory 
course in adaptive control could be covered in Chapters f, 2, and 4 to 9, 
by excluding the more elaborate and difficult proofs of theorems that are 
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presented either in the last section of chapters or in the appendices. Chapter 
3 could be used for reference and for covering relevant stability results that 
arise during the course. A higher-level course intended for graduate students 
that are interested in a deeper understanding of adaptive control could cover 
all chapters with more emphasis on the design and stability proofs. A course 
for an industrial audience could contain Chapters 1, 2, and 4 to 9 with 
emphasis on the design of adaptive control algorithms rather than stability 
proofs and convergence. 
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Chapter 1 

Introduction 



1.1 Control System Design Steps 

The design of a controller that can alter or modify the behavior and response 
of an unknown plant to meet certain performance requirements can be a 
tedious and challenging problem in many control applications. By plant, we 
mean any process characterized by a certain number of inputs u and outputs 
y, as shown in Figure 1.1. 

The plant inputs u are processed to produce several plant outputs y that 
represent the measured output response of the plant. The control design task 
is to choose the input u so that the output response y(t) satisfies certain given 
performance requirements. Because the plant process is usually complex, 
i.e., it may consist of various mechanical, electronic, hydraulic parts, etc., 
the appropriate choice of n is in general not straightforward. The control 
design steps often followed by most control engineers in choosing the input 
u are shown in Figure 1.2 and are explained below. 



Inputs- 

u ~ 



^ 



Plant 

Process 

P 



^ 



Outputs 

y 



Figure 1.1 Plant representation. 
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Step 1. Modeling 

The task of the control engineer in this step is to understand the pro- 
cessing mechanism of the plant, which takes a given input signal u(t) and 
produces the output response y(t), to the point that he or she can describe 
it in the form of some mathematical equations. These equations constitute 
the mathematical model of the plant. An exact plant model should produce 
the same output response as the plant, provided the input to the model and 
initial conditions are exactly the same as those of the plant. The complexity 
of most physical plants, however, makes the development of such an exact 
model unwarranted or even impossible. But even if the exact plant model 
becomes available, its dimension is likely to be infinite, and its description 
nonlinear or time varying to the point that its usefulness from the control 
design viewpoint is minimal or none. This makes the task of modeling even 
more difficult and challenging, because the control engineer has to come up 
with a mathematical model that describes accurately the input/output be- 
havior of the plant and yet is simple enough to be used for control design 
purposes. A simple model usually leads to a simple controller that is easier 
to understand and implement, and often more reliable for practical purposes. 

A plant model may be developed by using physical laws or by processing 
the plant input /output (I/O) data obtained by performing various experi- 
ments. Such a model, however, may still be complicated enough from the 
control design viewpoint and further simplifications may be necessary. Some 
of the approaches often used to obtain a simplified model are 

(i) Linearization around operating points 
(ii) Model order reduction techniques 

In approach (i) the plant is approximated by a linear model that is valid 
around a given operating point. Different operating points may lead to 
several different linear models that are used as plant models. Linearization 
is achieved by using Taylor's series expansion and approximation, fitting of 
experimental data to a linear model, etc. 

In approach (ii) small effects and phenomena outside the frequency range 
of interest are neglected leading to a lower order and simpler plant model. 
The reader is referred to references [67, 106] for more details on model re- 
duction techniques and approximations. 
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Figure 1.2 Control system design steps. 

In general, the task of modeling involves a good understanding of the 
plant process and performance requirements, and may require some experi- 
ence from the part of the control engineer. 

Step 2. Controller Design 

Once a model of the plant is available, one can proceed with the controller 
design. The controller is designed to meet the performance requirements for 



4 CHAPTER 1. INTRODUCTION 

the plant model. If the model is a good approximation of the plant, then 
one would hope that the controller performance for the plant model would 
be close to that achieved when the same controller is applied to the plant. 

Because the plant model is always an approximation of the plant, the 
effect of any discrepancy between the plant and the model on the perfor- 
mance of the controller will not be known until the controller is applied to 
the plant in Step 3. One, however, can take an intermediate step and ana- 
lyze the properties of the designed controller for a plant model that includes 
a class of plant model uncertainties denoted by A that are likely to appear 
in the plant. If A represents most of the unmodeled plant phenomena, its 
representation in terms of mathematical equations is not possible. Its char- 
acterization, however, in terms of some known bounds may be possible in 
many applications. By considering the existence of a general class of uncer- 
tainties A that are likely to be present in the plant, the control engineer may 
be able to modify or redesign the controller to be less sensitive to uncertain- 
ties, i.e., to be more robust with respect to A. This robustness analysis and 
redesign improves the potential for a successful implementation in Step 3. 

Step 3. Implementation 

In this step, a controller designed in Step 2, which is shown to meet the 
performance requirements for the plant model and is robust with respect to 
possible plant model uncertainties A, is ready to be applied to the unknown 
plant. The implementation can be done using a digital computer, even 
though in some applications analog computers may be used too. Issues, 
such as the type of computer available, the type of interface devices between 
the computer and the plant, software tools, etc., need to be considered a 
priori. Computer speed and accuracy limitations may put constraints on 
the complexity of the controller that may force the control engineer to go 
back to Step 2 or even Step 1 to come up with a simpler controller without 
violating the performance requirements. 

Another important aspect of implementation is the final adjustment, 
or as often called the tuning, of the controller to improve performance by 
compensating for the plant model uncertainties that are not accounted for 
during the design process. Tuning is often done by trial and error, and 
depends very much on the experience and intuition of the control engineer. 

In this book we will concentrate on Step 2. We will be dealing with 
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the design of control algorithms for a class of plant models described by the 
linear differential equation 

X = Ax + Bu, x(0) = xo 

y 



C^x + Du ^ ' 



In (1.1.1) x e 7Z^ is the state of the model, u £ TZ^ the plant input, and y G 
n^ the plant model output. The matrices A e 71"^", B e 7^"^^ C e 7^"^^ 
and D e 7Z could be constant or time varying. This class of plant models 
is quite general because it can serve as an approximation of nonlinear plants 
around operating points. A controller based on the linear model (1.1.1) is 
expected to be simpler and easier to understand than a controller based on 
a possibly more accurate but nonlinear plant model. 

The class of plant models given by (1.1.1) can be generalized further if we 
allow the elements of A, B, and C to be completely unknown and changing 
with time or operating conditions. The control of plant models (1.1.1) with 
A, B, C, and D unknown or partially known is covered under the area of 
adaptive systems and is the main topic of this book. 

1.2 Adaptive Control 

According to Webster's dictionary, to adapt means "to change (oneself) so 
that one's behavior will conform to new or changed circumstances." The 
words "adaptive systems" and "adaptive control" have been used as early 
as 1950 [10, 27]. 

The design of autopilots for high-performance aircraft was one of the pri- 
mary motivations for active research on adaptive control in the early 1950s. 
Aircraft operate over a wide range of speeds and altitudes, and their dy- 
namics are nonlinear and conceptually time varying. For a given operating 
point, specified by the aircraft speed (Mach number) and altitude, the com- 
plex aircraft dynamics can be approximated by a linear model of the same 
form as (1.1.1). For example, for an operating point i, the linear aircraft 
model has the following form [140]: 

X = Aix + BiU, x(0) = Xo n 9 n 

y = Cjx + DiU ^'■^■'> 

where Ai,Bi,Ci, and Di are functions of the operating point i. As the air- 
craft goes through different flight conditions, the operating point changes 
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Figure 1.3 Controller structure with adjustable controller gains. 

leading to different values for Ai,Bi,Ci, and Dj. Because the output re- 
sponse y{t) carries information about the state x as well as the parameters, 
one may argue that in principle, a sophisticated feedback controller should 
be able to learn about parameter changes by processing y(t) and use the 
appropriate gains to accommodate them. This argument led to a feedback 
control structure on which adaptive control is based. The controller struc- 
ture consists of a feedback loop and a controller with adjustable gains as 
shown in Figure 1.3. The way of changing the controller gains in response 
to changes in the plant and disturbance dynamics distinguishes one scheme 
from another. 



1.2.1 Robust Control 

A constant gain feedback controller may be designed to cope with parameter 
changes provided that such changes are within certain bounds. A block 
diagram of such a controller is shown in Figure 1.4 where G(s) is the transfer 
function of the plant and C{s) is the transfer function of the controller. The 
transfer function from y* to y is 



y_ 
y* 



C{s)G{s) 
l + C{s)G{s) 



(1.2.2) 



where C(s) is to be chosen so that the closed-loop plant is stable, despite 
parameter changes or uncertainties in G(s), and y ^ y* within the frequency 
range of interest. This latter condition can be achieved if we choose C{s) 
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Figure 1.4 Constant gain feedback controller. 

so that the loop gain \C{j'w)G{jw)\ is as large as possible in the frequency 
spectrum of y* provided, of course, that large loop gain does not violate 
closed-loop stability requirements. The tracking and stability objectives can 
be achieved through the design of C{s) provided the changes within G{s) 
are within certain bounds. More details about robust control will be given 
in Chapter 8. 

Robust control is not considered to be an adaptive system even though 
it can handle certain classes of parametric and dynamic uncertainties. 



1.2.2 Gain Scheduling 

Let us consider the aircraft model (1.2.1) where for each operating point 
i, i = 1,2, ... ,N, the parameters Ai,Bi,Ci, and Di are known. For a 
given operating point i, a feedback controller with constant gains, say 9i, 
can be designed to meet the performance requirements for the correspond- 
ing linear model. This leads to a controller, say C(6), with a set of gains 
{^1, ^2, •••, 0i, ■■■, On} covering N operating points. Once the operating point, 
say i, is detected the controller gains can be changed to the appropriate value 
of 6i obtained from the precomputed gain set. Transitions between different 
operating points that lead to significant parameter changes may be handled 
by interpolation or by increasing the number of operating points. The two 
elements that are essential in implementing this approach is a look-up table 
to store the values of 9i and the plant auxiliary measurements that corre- 
late well with changes in the operating points. The approach is called gain 
scheduling and is illustrated in Figure 1.5. 

The gain scheduler consists of a look-up table and the appropriate logic 
for detecting the operating point and choosing the corresponding value of 
9i from the table. In the case of aircraft, the auxiliary measurements are 
the Mach number and the dynamic pressure. With this approach plant 
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Figure 1.5 Gain scheduling. 

parameter variations can be compensated by changing the controller gains 
as functions of the auxiliary measurements. 

The advantage of gain scheduling is that the controller gains can be 
changed as quickly as the auxiliary measurements respond to parameter 
changes. Frequent and rapid changes of the controller gains, however, may 
lead to instability [226]; therefore, there is a limit as to how often and how 
fast the controller gains can be changed. 

One of the disadvantages of gain scheduling is that the adjustment mech- 
anism of the controller gains is precomputed off-line and, therefore, provides 
no feedback to compensate for incorrect schedules. Unpredictable changes 
in the plant dynamics may lead to deterioration of performance or even to 
complete failure. Another possible drawback of gain scheduling is the high 
design and implementation costs that increase with the number of operating 
points. 

Despite its limitations, gain scheduling is a popular method for handling 
parameter variations in flight control [140, 210] and other systems [8]. 



1.2.3 Direct and Indirect Adaptive Control 

An adaptive controller is formed by combining an on-line parameter estima- 
tor, which provides estimates of unknown parameters at each instant, with 
a control law that is motivated from the known parameter case. The way 
the parameter estimator, also referred to as adaptive law in the book, is 
combined with the control law gives rise to two different approaches. In the 
first approach, referred to as indirect adaptive control, the plant parameters 
are estimated on-line and used to calculate the controller parameters. This 
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approach has also been referred to as explicit adaptive control, because the 
design is based on an expUcit plant model. 

In the second approach, referred to as direct adaptive control, the plant 
model is parameterized in terms of the controller parameters that are esti- 
mated directly without intermediate calculations involving plant parameter 
estimates. This approach has also been referred to as implicit adaptive con- 
trol because the design is based on the estimation of an implicit plant model. 

In indirect adaptive control, the plant model P{9*) is parameterized with 
respect to some unknown parameter vector 9*. For example, for a linear 
time invariant (LTI) single-input single-output (SISO) plant model, 0* may 
represent the unknown coefficients of the numerator and denominator of the 
plant model transfer function. An on-line parameter estimator generates 
an estimate 9{t) of 9* at each time t by processing the plant input u and 
output y. The parameter estimate 9{t) specifies an estimated plant model 
characterized by P{9{t)) that for control design purposes is treated as the 
"true" plant model and is used to calculate the controller parameter or gain 
vector 9c{t) by solving a certain algebraic equation 9c{t) = F{9{t)) at each 
time t. The form of the control law C{9c) and algebraic equation 9^ = F{9) 
is chosen to be the same as that of the control law C{9*) and equation 9* = 
F{9*) that could be used to meet the performance requirements for the plant 
model P{9*) if 9* was known. It is, therefore, clear that with this approach, 
C{9c{t)) is designed at each time t to satisfy the performance requirements 
for the estimated plant model P{9{t)), which may be different from the 
unknown plant model P{9*). Therefore, the principal problem in indirect 
adaptive control is to choose the class of control laws C{9c) and the class 
of parameter estimators that generate 9(t) as well as the algebraic equation 
9c{t) = F{9{t)) so that C{9c{t)) meets the performance requirements for 
the plant model P{9*) with unknown 9*. We will study this problem in 
great detail in Chapters 6 and 7, and consider the robustness properties of 
indirect adaptive control in Chapters 8 and 9. The block diagram of an 
indirect adaptive control scheme is shown in Figure 1.6. 

In direct adaptive control, the plant model P{9*) is parameterized in 
terms of the unknown controller parameter vector ^*, for which C{9*) meets 
the performance requirements, to obtain the plant model Pci9*) with exactly 
the same input/output characteristics as P{9*). 

The on-line parameter estimator is designed based on Pc{9*) instead of 
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Figure 1.6 Indirect adaptive control. 



P{9*) to provide direct estimates 6c{t) of 9^ at each time t by processing the 
plant input u and output y. The estimate 9c{t) is then used to update the 
controller parameter vector 9c without intermediate calculations. The choice 
of the class of control laws 0(9^) and parameter estimators generating 9c{t) 
for which C{9c{t)) meets the performance requirements for the plant model 
P{9*) is the fundamental problem in direct adaptive control. The properties 
of the plant model P{9*) are crucial in obtaining the parameterized plant 
model Pci9*) that is convenient for on-line estimation. As a result, direct 
adaptive control is restricted to a certain class of plant models. As we will 
show in Chapter 6, a class of plant models that is suitable for direct adaptive 
control consists of all SISO LTI plant models that are minimum-phase, i.e., 
their zeros are located in Re [s] < 0. The block diagram of direct adaptive 
control is shown in Figure 1.7. 

The principle behind the design of direct and indirect adaptive control 
shown in Figures 1.6 and 1.7 is conceptually simple. The design of C{9c) 
treats the estimates 9c{t) (in the case of direct adaptive control) or the 
estimates 9{t) (in the case of indirect adaptive control) as if they were the 
true parameters. This design approach is called certainty equivalence and can 
be used to generate a wide class of adaptive control schemes by combining 
different on-line parameter estimators with different control laws. 
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Figure 1.7 Direct adaptive control. 



The idea behind the certainty equivalence approach is that as the param- 
eter estimates 9c{t) and 6{t) converge to the true ones 9* and 0*, respectively, 
the performance of the adaptive controller C{6c) tends to that achieved by 
C{0*) in the case of known parameters. 

The distinction between direct and indirect adaptive control may be con- 
fusing to most readers for the following reasons: The direct adaptive control 
structure shown in Figure 1.7 can be made identical to that of the indi- 
rect adaptive control by including a block for calculations with an identity 
transformation between updated parameters and controller parameters. In 
general, for a given plant model the distinction between the direct and in- 
direct approach becomes clear if we go into the details of design and anal- 
ysis. For example, direct adaptive control can be shown to meet the per- 
formance requirements, which involve stability and asymptotic tracking, for 
a minimum-phase plant. It is still not clear how to design direct schemes 
for nonminimum-phase plants. The difficulty arises from the fact that, in 
general, a convenient (for the purpose of estimation) parameterization of the 
plant model in terms of the desired controller parameters is not possible for 
nonminimum-phase plant models. 

Indirect adaptive control, on the other hand, is applicable to both 
minimum- and nonminimum-phase plants. In general, however, the mapping 
between 9{t) and 6c{t), defined by the algebraic equation 9c{t) = F(9(t)), 
cannot be guaranteed to exist at each time t giving rise to the so-called 
stabilizability problem that is discussed in Chapter 7. As we will show in 
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Figure 1.8 Model reference control. 

Chapter 7, solutions to the stabilizability problem are possible at the expense 
of additional complexity. 

Efforts to relax the minimum-phase assumption in direct adaptive control 
and resolve the stabilizability problem in indirect adaptive control led to 
adaptive control schemes where both the controller and plant parameters 
are estimated on-line, leading to combined direct/indirect schemes that are 
usually more complex [112]. 



1.2.4 Model Reference Adaptive Control 

Model reference adaptive control (MRAC) is derived from the model follow- 
ing problem or model reference control (MRC) problem. In MRC, a good 
understanding of the plant and the performance requirements it has to meet 
allow the designer to come up with a model, referred to as the reference 
model, that describes the desired I/O properties of the closed-loop plant. 
The objective of MRC is to find the feedback control law that changes the 
structure and dynamics of the plant so that its I/O properties are exactly 
the same as those of the reference model. The structure of an MRC scheme 
for a LTI, SISO plant is shown in Figure 1.8. The transfer function Wm{s) of 
the reference model is designed so that for a given reference input signal r{t) 
the output ym{t) of the reference model represents the desired response the 
plant output y{t) should follow. The feedback controller denoted by C(9*) 
is designed so that all signals are bounded and the closed-loop plant transfer 
function from r to y is equal to Wmis). This transfer function matching 
guarantees that for any given reference input r{t), the tracking error 
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Figure 1.9 Indirect MRAC. 

ei = y — i/m, which represents the deviation of the plant output from the 
desired trajectory ym, converges to zero with time. The transfer function 
matching is achieved by canceling the zeros of the plant transfer function 
G{s) and replacing them with those of Wmis) through the use of the feedback 
controller C(6*). The cancellation of the plant zeros puts a restriction on 
the plant to be minimum phase, i.e., have stable zeros. If any plant zero is 
unstable, its cancellation may easily lead to unbounded signals. 

The design of C{6*) requires the knowledge of the coefficients of the plant 
transfer function G{s). If 9* is a vector containing all the coefficients of 
G(s) = G{s,9*), then the parameter vector 9* may be computed by solving 
an algebraic equation of the form 



9* = F{9*) 



(1.2.3) 



It is, therefore, clear that for the MRC objective to be achieved the plant 
model has to be minimum phase and its parameter vector 0* has to be known 
exactly. 
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Figure 1.10 Direct MRAC. 

When 6* is unknown the MRC scheme of Figure 1.8 cannot be imple- 
mented because ^* cannot be calculated using (1.2.3) and is, therefore, un- 
known. One way of dealing with the unknown parameter case is to use the 
certainty equivalence approach to replace the unknown 0* in the control law 
with its estimate 9c{t) obtained using the direct or the indirect approach. 
The resulting control schemes are known as MRAC and can be classified as 
indirect MRAC shown in Figure 1.9 and direct MRAC shown in Figure 1.10. 

Different choices of on-line parameter estimators lead to further classifi- 
cations of MRAC. These classifications and the stability properties of both 
direct and indirect MRAC will be studied in detail in Chapter 6. 

Other approaches similar to the certainty equivalence approach may be 
used to design direct and indirect MRAC schemes. The structure of these 
schemes is a modification of those in Figures 1.9 and 1.10 and will be studied 
in Chapter 6. 



1.2.5 Adaptive Pole Placement Control 

Adaptive pole placement control (APPC) is derived from the pole placement 
control (PPC) and regulation problems used in the case of LTI plants with 
known parameters. 
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Figure 1.11 Pole placement control. 



In PPC, the performance requirements are translated into desired loca- 
tions of the poles of the closed-loop plant. A feedback control law is then 
developed that places the poles of the closed-loop plant at the desired loca- 
tions. A typical structure of a PPC scheme for a LTI, SISO plant is shown 
in Figure 1.11. 

The structure of the controller C{6*) and the parameter vector 9* are 
chosen so that the poles of the closed-loop plant transfer function from r to 
y are equal to the desired ones. The vector 6* is usually calculated using an 
algebraic equation of the form 



e* = rm 



(1.2.4) 



where 9* is a vector with the coefficients of the plant transfer function G(s). 
If 9* is known, then 9* is calculated from (1.2.4) and used in the control 
law. When 9* is unknown, 9* is also unknown, and the PPC scheme of 
Figure 1.11 cannot be implemented. As in the case of MRC, we can deal with 
the unknown parameter case by using the certainty equivalence approach to 
replace the unknown vector 9* with its estimate 9c{t). The resulting scheme 
is referred to as adaptive pole placement control (APPC). If 9c{t) is updated 
directly using an on-line parameter estimator, the scheme is referred to as 
direct APPC. If 9c{t) is calculated using the equation 



,(t) = Fi9it)) 



(1.2.5) 



where 9(t) is the estimate of 9* generated by an on-line estimator, the scheme 
is referred to as indirect APPC. The structure of direct and indirect APPC 
is the same as that shown in Figures 1.6 and 1.7 respectively for the general 
case. 

The design of APPC schemes is very flexible with respect to the choice 
of the form of the controller C{9c) and of the on-line parameter estimator. 
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For example, the control law may be based on the linear quadratic design 
technique, frequency domain design techniques, or any other PPC method 
used in the known parameter case. Various combinations of on-line estima- 
tors and control laws lead to a wide class of APPC schemes that are studied 
in detail in Chapter 7. 

APPC schemes are often referred to as self-tuning regulators in the hter- 
ature of adaptive control and are distinguished from MRAC. The distinction 
between APPC and MRAC is more historical than conceptual because as 
we will show in Chapter 7, MRAC can be considered as a special class of 
APPC. MRAC was first developed for continuous-time plants for model fol- 
lowing, whereas APPC was initially developed for discrete-time plants in a 
stochastic environment using minimization techniques. 

1.2.6 Design of On-Line Parameter Estimators 

As we mentioned in the previous sections, an adaptive controller may be con- 
sidered as a combination of an on-line parameter estimator with a control 
law that is derived from the known parameter case. The way this combina- 
tion occurs and the type of estimator and control law used gives rise to a 
wide class of different adaptive controllers with different properties. In the 
literature of adaptive control the on-line parameter estimator has often been 
referred to as the adaptive law, update law, or adjustment mechanism. In this 
book we will often refer to it as the adaptive law. The design of the adaptive 
law is crucial for the stability properties of the adaptive controller. As we 
will see in this book the adaptive law introduces a multiplicative nonlinearity 
that makes the closed-loop plant nonlinear and often time varying. Because 
of this, the analysis and understanding of the stability and robustness of 
adaptive control schemes are more challenging. 

Some of the basic methods used to design adaptive laws are 

(i) Sensitivity methods 
(ii) Positivity and Lyapunov design 

(iii) Gradient method and least-squares methods based on estimation error 
cost criteria 

The last three methods are used in Chapters 4 and 8 to design a wide class 
of adaptive laws. The sensitivity method is one of the oldest methods used 
in the design of adaptive laws and will be briefly explained in this section 
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together with the other three methods for the sake of completeness. It will 
not be used elsewhere in this book for the simple reason that in theory the 
adaptive laws based on the last three methods can be shown to have better 
stability properties than those based on the sensitivity method. 

(i) Sensitivity methods 

This method became very popular in the 1960s [34, 104], and it is still 
used in many industrial applications for controlling plants with uncertainties. 
In adaptive control, the sensitivity method is used to design the adaptive 
law so that the estimated parameters are adjusted in a direction that min- 
imizes a certain performance function. The adaptive law is driven by the 
partial derivative of the performance function with respect to the estimated 
parameters multiplied by an error signal that characterizes the mismatch 
between the actual and desired behavior. This derivative is called sensitivity 
function and if it can be generated on-line then the adaptive law is imple- 
mentable. In most formulations of adaptive control, the sensitivity function 
cannot be generated on-line, and this constitutes one of the main drawbacks 
of the method. The use of approximate sensitivity functions that are im- 
plementable leads to adaptive control schemes whose stability properties are 
either weak or cannot be established. 

As an example let us consider the design of an adaptive law for updating 
the controller parameter vector 6c of the direct MRAC scheme of Figure 1.10. 

The tracking error ei represents the deviation of the plant output y from 
that of the reference model, i.e., ei = y — y^. Because 6c = 6* implies that 
ei = at steady state, a nonzero value of ei may be taken to imply that 
6c ^ 6*. Because y depends on dc, i.e., y = y{6c) we have ei = ei(0c) and, 
therefore, one way of reducing ei to zero is to adjust 6c in a direction that 
minimizes a certain cost function of ei. A simple cost function for ei is the 
quadratic function 

J{6c) = ^ (1.2.6) 

A simple method for adjusting dc to minimize J{6c) is the method of 
steepest descent or gradient method (see Appendix B) that gives us the 
adaptive law 

dc = -iVJiOc) = -7eiVei(^e) (1-2.7) 
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where 



Vei(^e 
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dei de\ 



is the gradient of ei with respect to 



dei 



de,i'd9c2'"''d0c 
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6c — [del , ^c2 , • • • , ' 



Because 



we have 



Vei(0c) = Vy(^e 



9c = -leiVyiOc 



(1.2.9) 



where 7 > is an arbitrary design constant referred to as the adaptive gain 



and 



dy 



- 1,2, ...,n are the sensitivity functions of y with respect to the 
elements of the controller parameter vector 8c- The sensitivity functions 
0^ represent the sensitivity of the plant output to changes in the controller 
parameter 9c- 

In (1.2.7) the parameter vector 9c is adjusted in the direction of steepest 

descent that decreases J {9c) = '^ ^ • ^^ -^(^c) is a convex function, then it 
has a global minimum that satisfies Vy{9c) = 0, i.e., at the minimum 0c = 
and adaptation stops. 

The implementation of (1.2.9) requires the on-line generation of the sen- 
sitivity functions Vy that usually depend on the unknown plant parameters 
and are, therefore, unavailable. In these cases, approximate values of the 
sensitivity functions are used instead of the actual ones. One type of ap- 
proximation is to use some a priori knowledge about the plant parameters 
to compute the sensitivity functions. 

A popular method for computing the approximate sensitivity functions 
is the so-called MIT rule. With this rule the unknown parameters that are 
needed to generate the sensitivity functions are replaced by their on-line esti- 
mates. Unfortunately, with the use of approximate sensitivity functions, it is 
not possible, in general, to prove global closed-loop stability and convergence 
of the tracking error to zero. In simulations, however, it was observed that 
the MIT rule and other approximation techniques performed well when the 
adaptive gain 7 and the magnitude of the reference input signal are small. 
Averaging techniques are used in [135] to confirm these observations and es- 
tablish local stability for a certain class of reference input signals. Globally, 



1.2. ADAPTIVE CONTROL 19 

however, the schemes based on the MIT rule and other approximations may 
go unstable. Examples of instability are presented in [93, 187, 202]. 

We illustrate the use of the MIT rule for the design of an MRAC scheme 
for the plant 

y=-aiy-a2y + u (1.2.10) 

where ai and 02 are the unknown plant parameters, and y and y are available 
for measurement. 

The reference model to be matched by the closed loop plant is given by 



The control law 



where 



ym = -'^i/m - Vm + r (1.2.11) 

u = eiy + d*2y + r (1.2.12) 

r^ = ai-2,e*2 = a2-l (1.2.13) 



will achieve perfect model following. The equation (1.2.13) is referred to as 
the matching equation. Because ai and 02 are unknown, the desired values 
of the controller parameters $1 and 82 cannot be calculated from (1.2.13). 
Therefore, instead of (1.2.12) we use the control law 

u=eiy + e2y + r (1.2.14) 

where 9i and 62 are adjusted using the MIT rule as 

^i = -7ei^, 02 = -je^— (1.2.15) 

where ei = y—ym- To implement (1.2.15), we need to generate the sensitivity 
functions q^, q^ on-line. 

Using (1.2.10) and (1.2.14) we obtain 

dy dij dy , . , . dij dy n o i«\ 

dy dy dy , n ^y ^ ^ dy n o 1 '7^ 

W2 = -''de-2-'''W2^y^^'W2^''de-2 ^'-'-''^ 



20 CHAPTER 1. INTRODUCTION 

If we now assume that the rate of adaptation is slow, i.e., 9i and 62 are 
small, and the changes of y and y with respect to 61 and 82 are also small, 
we can interchange the order of differentiation to obtain 



d' dy 


dtdOi 


^ dy . 


(1.2.18) 


d' dy _ 

dt^ 862 ^^' " 


\ d dy ,. 




(1.2.19) 


which we may rewrite as 
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(1.2.20) 
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(1.2.21) 


dQ2 


p2-(0i-ai)p- 


-{92-a2f 



where p{-) = ^(■) is the diiferential operator. 

Because oi and 02 are unknown, the above sensitivity functions cannot 
be used. Using the MIT rule, we replace ai and 02 with their estimates di 
and 0,2 in the matching equation (1.2.13), i.e., we relate the estimates di and 
02 with 01 and 62 using 

ai = 6'i + 2, 02 = 02 + 1 (1.2.22) 

and obtain the approximate sensitivity functions 

Wi "^ p2 + 2p+l^' W2 "^ p^ + 2p+l^ (1.2.23) 

The equations given by (1.2.23) are known as the sensitivity filters or mod- 
els, and can be easily implemented to generate the approximate sensitivity 
functions for the adaptive law (1.2.15). 

As shown in [93, 135], the MRAC scheme based on the MIT rule is 
locally stable provided the adaptive gain 7 is small, the reference input 
signal has a small amplitude and sufficient number of frequencies, and the 
initial conditions 0i(O) and ^2(0) are close to 9\ and 62 respectively. 

For larger 7 and 0i(O) and ^2(0) away from 6\ and 62, the MIT rule may 
lead to instability and unbounded signal response. 
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The lack of stability of MIT rule based adaptive control schemes promp- 
ted several researchers to look for different methods of designing adaptive 
laws. These methods include the positivity and Lyapunov design approach, 
and the gradient and least-squares methods that are based on the minimiza- 
tion of certain estimation error criteria. These methods are studied in detail 
in Chapters 4 and 8, and are briefly described below. 

(ii) Positivity and Lyapunov design 

This method of developing adaptive laws is based on the direct method 
of Lyapunov and its relationship with positive real functions. In this ap- 
proach, the problem of designing an adaptive law is formulated as a sta- 
bility problem where the differential equation of the adaptive law is chosen 
so that certain stability conditions based on Lyapunov theory are satisfied. 
The adaptive law developed is very similar to that based on the sensitivity 
method. The only difference is that the sensitivity functions in the approach 
(i) are replaced with ones that can be generated on-line. In addition, the 
Lyapunov-based adaptive control schemes have none of the drawbacks of the 
MIT rule-based schemes. 

The design of adaptive laws using Lyapunov's direct method was sug- 
gested by Grayson [76], Parks [187], and Shackcloth and Butchart [202] in 
the early 1960s. The method was subsequently advanced and generalized to 
a wider class of plants by Phillipson [188], Monopoli [149], Narendra [172], 
and others. 

A significant part of Chapters 4 and 8 will be devoted to developing 
adaptive laws using the Lyapunov design approach. 

(iii) Gradient and least-squares methods based on estimation 
error cost criteria 

The main drawback of the sensitivity methods used in the 1960s is that 
the minimization of the performance cost function led to sensitivity functions 
that are not implement able. One way to avoid this drawback is to choose a 
cost function criterion that leads to sensitivity functions that are available for 
measurement. A class of such cost criteria is based on an error referred to as 
the estimation error that provides a measure of the discrepancy between the 
estimated and actual parameters. The relationship of the estimation error 
with the estimated parameters is chosen so that the cost function is convex, 
and its gradient with respect to the estimated parameters is implementable. 
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Several different cost criteria may be used, and methods, such as the gradient 
and least-squares, may be adopted to generate the appropriate sensitivity 
functions. 

As an example, let us design the adaptive law for the direct MRAC law 
(1.2.14) for the plant (1.2.10). 

We first rewrite the plant equation in terms of the desired controller 
parameters given by (1.2.13), i.e., we substitute for ai = 2 + 61, 02 = 1 + ^2 
in (1.2.10) to obtain 

y=-2y-y-0ly-9*^y + u (1.2.24) 

which may be rewritten as 

y = eiijf + eiyf + Uf (1.2.25) 

where 

^^=-.2+L+i^' y/=-.2+L+i^' ^^=.2+L+i" ('-'-''^ 

are signals that can be generated by filtering. 

If we now replace 6\ and 62 with their estimates 9i and 62 in equation 
(1.2.25), we will obtain, 

y = Oiyj + 022// + Uf (1.2.27) 

where y is the estimate of y based on the estimate 9i and $2 of 9^ and 62- 
The error 

£i = y-y = y- ^ly/ - 02yf - uf (1.2.28) 

is, therefore, a measure of the discrepancy between 6i, 92 and 91,92, respec- 
tively. We refer to it as the estimation error. The estimates 9i and 62 can 
now be adjusted in a direction that minimizes a certain cost criterion that 
involves ei. A simple such criterion is 

J{0i,92) = ^ = i(y - 9iyf - ^2?// - Uff (1.2.29) 

which is to be minimized with respect to 0i, ^2- It is clear that J{9i, ^2) is a 
convex function of 9i, 62 and, therefore, the minimum is given by V J = 0. 
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If we now use the gradient method to minimize J{9i, O2), we obtain the 
adaptive laws 

dJ ■ dJ 

01 = -Ii-qTj- = li^Wf, 6*2 = -72^ = 72£iy/ (1.2.30) 

where 71,72 > are the adaptive gains and ei,yf,yf are all implementable 
signals. 

Instead of (1.2.29), one may use a diiferent cost criterion for ei and a 
different minimization method leading to a wide class of adaptive laws. In 
Chapters 4 to 9 we will examine the stability properties of a wide class 
of adaptive control schemes that are based on the use of estimation error 
criteria, and gradient and least-squares type of optimization techniques. 

1.3 A Brief History 

Research in adaptive control has a long history of intense activities that 
involved debates about the precise definition of adaptive control, examples 
of instabilities, stability and robustness proofs, and applications. 

Starting in the early 1950s, the design of autopilots for high-performance 
aircraft motivated an intense research activity in adaptive control. High- 
performance aircraft undergo drastic changes in their dynamics when they fly 
from one operating point to another that cannot be handled by constant-gain 
feedback control. A sophisticated controller, such as an adaptive controller, 
that could learn and accommodate changes in the aircraft dynamics was 
needed. Model reference adaptive control was suggested by Whitaker et 
al. in [184, 235] to solve the autopilot control problem. The sensitivity 
method and the MIT rule was used to design the adaptive laws of the various 
proposed adaptive control schemes. An adaptive pole placement scheme 
based on the optimal linear quadratic problem was suggested by Kalman in 
[96]. 

The work on adaptive flight control was characterized by "a lot of en- 
thusiasm, bad hardware and non-existing theory" [11]. The lack of stability 
proofs and the lack of understanding of the properties of the proposed adap- 
tive control schemes coupled with a disaster in a flight test [219] caused the 
interest in adaptive control to diminish. 
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The 1960s became the most important period for the development of 
control theory and adaptive control in particular. State space techniques 
and stability theory based on Lyapunov were introduced. Developments 
in dynamic programming [19, 20], dual control [53] and stochastic control 
in general, and in system identification and parameter estimation [13, 229] 
played a crucial role in the reformulation and redesign of adaptive control. 
By 1966 Parks and others found a way of redesigning the MIT rule-based 
adaptive laws used in the MRAC schemes of the 1950s by applying the 
Lyapunov design approach. Their work, even though applicable to a special 
class of LTI plants, set the stage for further rigorous stability proofs in 
adaptive control for more general classes of plant models. 

The advances in stability theory and the progress in control theory in 
the 1960s improved the understanding of adaptive control and contributed 
to a strong renewed interest in the field in the 1970s. On the other hand, 
the simultaneous development and progress in computers and electronics 
that made the implementation of complex controllers, such as the adaptive 
ones, feasible contributed to an increased interest in applications of adaptive 
control. The 1970s witnessed several breakthrough results in the design 
of adaptive control. MRAC schemes using the Lyapunov design approach 
were designed and analyzed in [48, 153, 174]. The concepts of positivity 
and hyperstability were used in [123] to develop a wide class of MRAC 
schemes with well-established stability properties. At the same time parallel 
efforts for discrete-time plants in a deterministic and stochastic environment 
produced several classes of adaptive control schemes with rigorous stability 
proofs [72, 73]. The excitement of the 1970s and the development of a wide 
class of adaptive control schemes with well established stability properties 
was accompanied by several successful applications [80, 176, 230]. 

The successes of the 1970s, however, were soon followed by controversies 
over the practicality of adaptive control. As early as 1979 it was pointed 
out that the adaptive schemes of the 1970s could easily go unstable in the 
presence of small disturbances [48]. The nonrobust behavior of adaptive 
control became very controversial in the early 1980s when more examples of 
instabilities were published demonstrating lack of robustness in the presence 
of unmo deled dynamics or bounded disturbances [85, 197]. This stimulated 
many researchers, whose objective was to understand the mechanisms of 
instabilities and find ways to counteract them. By the mid 1980s, several 
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new redesigns and modifications were proposed and analyzed, leading to a 
body of work known as robust adaptive control. An adaptive controller is 
defined to be robust if it guarantees signal boundedness in the presence of 
"reasonable" classes of unniodeled dynamics and bounded disturbances as 
well as performance error bounds that are of the order of the modeling error. 

The work on robust adaptive control continued throughout the 1980s 
and involved the understanding of the various robustness modifications and 
their unification under a more general framework [48, 87, 84] . 

The solution of the robustness problem in adaptive control led to the 
solution of the long-standing problem of controlling a linear plant whose 
parameters are unknown and changing with time. By the end of the 1980s 
several breakthrough results were published in the area of adaptive control 
for linear time- varying plants [226]. 

The focus of adaptive control research in the late 1980s to early 1990s 
was on performance properties and on extending the results of the 1980s to 
certain classes of nonlinear plants with unknown parameters. These efforts 
led to new classes of adaptive schemes, motivated from nonlinear system 
theory [98, 99] as well as to adaptive control schemes with improved transient 
and steady-state performance [39, 211]. 

Adaptive control has a rich literature full with different techniques for 
design, analysis, performance, and applications. Several survey papers [56, 
183], and books and monographs [3, 15, 23, 29, 48, 55, 61, 73, 77, 80, 85, 
94, 105, 123, 144, 169, 172, 201, 226, 229, 230] have already been published. 
Despite the vast literature on the subject, there is still a general feeling that 
adaptive control is a collection of unrelated technical tools and tricks. The 
purpose of this book is to unify the various approaches and explain them in 
a systematic and tutorial manner. 



Chapter 2 

Models for Dynamic Systems 



2.1 Introduction 

In this chapter, we give a brief account of various models and paranieteriza- 
tions of LTI systems. Emphasis is on those ideas that are useful in studying 
the parameter identification and adaptive control problems considered in 
subsequent chapters. 

We begin by giving a summary of some canonical state space models for 
LTI systems and of their characteristics. Next we study I/O descriptions 
for the same class of systems by using transfer functions and differential 
operators. We express transfer functions as ratios of two polynomials and 
present some of the basic properties of polynomials that are useful for control 
design and system modeling. 

systems that we express in a form in which parameters, such as coeffi- 
cients of polynomials in the transfer function description, are separated from 
signals formed by filtering the system inputs and outputs. These paramet- 
ric models and their properties are crucial in parameter identification and 
adaptive control problems to be studied in subsequent chapters. 

The intention of this chapter is not to give a complete picture of all 
aspects of LTI system modeling and representation, but rather to present a 
summary of those ideas that are used in subsequent chapters. For further 
discussion on the topic of modeling and properties of linear systems, we 
refer the reader to several standard books on the subject starting with the 
elementary ones [25, 41, 44, 57, 121, 180] and moving to the more advanced 

26 
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ones [30, 42, 95, 198, 237, 238]. 

2.2 State-Space Models 

2.2.1 General Description 

Many systems are described by a set of differential equations of the form 

y{t) = g{x{t),u{t),t) (2.2.1) 

where 

t is the time variable 

x{t) is an n-dimensional vector with real elements that denotes the state 

of the system 
u{t) is an r-dimensional vector with real elements that denotes the input 

variable or control input of the system 
y(t) is an /-dimensional vector with real elements that denotes the output 

variables that can be measured 
/, g are real vector valued functions 

n is the dimension of the state x called the order of the system 
x(fo) denotes the value of x(t) at the initial time t = Iq > 

When f,g are linear functions of x,u, (2.2.1) takes the form 

x = A(t)x + B(t)u, x(to) = Xo 

y = C^{t)x + D{t)u (2.2.2) 

where A{t) e 7^"^",5(t) e 7^"^^C(t) e 71"^', and D{t) e TZ^'"'" are ma- 
trices with time- varying elements. If in addition to being linear, f,g do not 
depend on time t, we have 

X = Ax + Bu, x(to) = xq 

y = C^x + Du (2.2.3) 

where A,B,C, and D are matrices of the same dimension as in (2.2.2) but 
with constant elements. 
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We refer to (2.2.2) as the finite-dimensional linear time-varying (LTV) 
system and to (2.2.3) as the finite dimensional LTI system. 
The solution x(t),y(t) of (2.2.2) is given by 

X(t) = ^(t,to)x(to)+ f ^it,T)B(T)u(T)dT 

•Ita 

y{t) = C'^ {t)x{t) + D{t)u{t) (2.2.4) 

where $(i, to) is the state transition matrix defined as a matrix that satisfies 
the linear homogeneous matrix equation 

^5^ = A(t)$(t,to), HtoM = I 
For the LTI system (2.2.3), $(i,to) depends only on the difference t — to, i.e., 

and the solution x(t),y(t) of (2.2.3) is given by 



x{t) = e^(*-*«)xo+ f'e^'^'-^^ Bu{T)dT 

■ha 

y{t) = C^x(t) + Du{t) (2.2.5) 



where e can be identified to be 

e^' = C-^[{sI - A)-^] 

where C~^ denotes the inverse Laplace transform and s is the Laplace vari- 
able. 

Usually the matrix D in (2.2.2), (2.2.3) is zero, because in most physical 
systems there is no direct path of nonzero gain between the inputs and 
outputs. 

In this book, we are concerned mainly with LTI, SISO systems with 
D = 0. In some chapters and sections, we will also briefly discuss systems of 
the form (2.2.2) and (2.2.3). 
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2.2.2 Canonical State-Space Forms 

Let us consider the SISO, LTI system 



X = Ax + Bu, 
y = C^x 



x{to) = Xo 



(2.2.6) 



where x e 7?.". The controllability matrix Pc of (2.2.6) is defined by 



P,= [B,AB,...,A^-^B\ 

A necessary and sufficient condition for the system (2.2.6) to be completely 
controllable is that Pc is nonsingular. If (2.2.6) is completely controllable, 
the linear transformation 

Xr = Pr^x 



(2.2.7) 



transforms (2.2.6) into the controllability canonical form 



• 


■ 


-oo 




1 


1 • 


• 


-ai 







1 • 


• 


-02 


Xc + 





0- 


■ 1 


-fln-i . 







Cjxc 











u 



(2.2.8) 



y -■ 

where the a^'s are the coefficients of the characteristic equation of A, i.e., 
det(s/ - A) = s" + a„_is"-i + ■ ■ ■ + oq and Cj = C^ Pc. 
If instead of (2.2.7), we use the transformation 



(2.2.9) 



where 



M 



Xc = 


M- 


'Pc 
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1 an- 


1 




02 
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02 
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we obtain the following controller canonical form 



-«n-i —an-2 





1 



-Ol 


-oo 















Xc + 



1 






u (2.2.10) 



Cq Xc 



where Cj = C^ PcM. By rearranging the elements of the state vector Xc, 
(2.2.10) may be written in the following form that often appears in books 
on linear system theory 



u (2.2.11) 






1 























1 









Xc + 

















1 







-ao 


-Ol 




-an- 


-2 


— Cn-l 




_ 1 



y = Cjxc 

where Ci is defined appropriately. 

The observability matrix Pq of (2.2.6) is defined by 



Pr 



A 



C^ 



(2.2.12) 



A necessary and sufficient condition for the system (2.2.6) to be completely 
observable is that Pq is nonsingular. By following the dual of the arguments 
presented earlier for the controllability and controller canonical forms, we 
arrive at observability and observer forms provided Pq is nonsingular [95] , 
i.e., the observability canonical form of (2.2.6) obtained by using the trans- 
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formation Xq = PqX is 



Xq 



y = [l,0,...,0]xo 
and the observer canonical form is 






1 
















1 
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-ao 


-ai 




-an-2 


-Qn-l 



Xo + BoU (2.2.13) 



a-n-i 
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an-2 
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-ai 
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■ 1 


-oo 





■ 


■ 



Xo + Biu 



(2.2.14) 



y 



[l,0,...,0]xo 



where Bq, Bi may be different. 

If the rank of the controllabihty matrix P^ for the nth-order system 
(2.2.6) is less than n, then (2.2.6) is said to be uncontrollable. Similarly, 
if the rank of the observability matrix Po is less than n, then (2.2.6) is 
unobservable. 

The system represented by (2.2.8) or (2.2.10) or (2.2.11) is completely 
controllable but not necessarily observable. Similarly, the system repre- 
sented by (2.2.13) or (2.2.14) is completely observable but not necessarily 
controllable. 

If the nth-order system (2.2.6) is either unobservable or uncontrollable 
then its I/O properties for zero initial state, i.e., xq = are completely 
characterized by a lower order completely controllable and observable system 



Xco 

V 






Xco{to) 







(2.2.15) 



where Xco £ 7?."'' and n^. < n. It turns out that no further reduction in the or- 
der of (2.2.15) is possible without affecting the I/O properties for all inputs. 



32 



CHAPTER 2. MODELS FOR DYNAMIC SYSTEMS 




Figure 2.1 Cart with two inverted pendulums 

For this reason (2.2.15) is referred to as the minimal state-space represen- 
tation of the system to be distinguished from the nonminimal state-space 
representation that corresponds to either an uncontrollable or unobservable 
system. 

A minimal state space model does not describe the uncontrollable or 
unobservable parts of the system. These parts may lead to some unbounded 
states in the nonminimal state-space representation of the system if any 
initial condition associated with these parts is nonzero. If, however, the 
uncontrollable or unobservable parts are asymptotically stable [95], they 
will decay to zero exponentially fast, and their effect may be ignored in 
most applications. A system whose uncontrollable parts are asymptotically 
stable is referred to as stabilizable, and the system whose unobservable parts 
are asymptotically stable is referred to as detectable [95]. 



Example 2.2.1 Let us consider the cart with the two inverted pendulums shown 
in Figure 2.1, where M is the mass of the cart, mi and m2 are the masses of the 
bobs, and li and I2 are the lengths of the pendulums, respectively. Using Newton's 



law and assuming small angular deviations of \9i\ 

given by 

Mi) = —rriic, " 
mi{v + Zi^i) 
m2{v + I2O2) 



\92\, the equations of motions are 



h - m2gt^2 + u 
= migOi 
= m2g02 

where v is the velocity of the cart, u is an external force, and g is the acceleration 
due to gravity. To simplify the algebra, let us assume that m,i = TO2 = Ikg and 
M = lOmi. If we now let xi = 6i,X2 = 0i,X3 = 61 — 62,X4 = 61 — 62 be the state 
variables, we obtain the following state-space representation for the system: 

X = Ax + Bu 
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where X = [a;i, 2:2, X3, X4] 



A: 



and ai 





l.2ai 



1.2(ai - 0:2) 



0:2 



h 



,"2 



,/3i 



ii 




-O.lai 


0.1(ai-a2) 




1 



p^ = -"-i- 





B 





/3i 



/3i-/32 



The controllability matrix of the system is given by 

Pc= [B,AB,A'^B,A^B] 
We can verify that 

detP, 



(0.011)Vai-^2)' 



C^x 



/4/4 

which implies that the system is controllable if and only if h ^ h- 

Let us now assume that 61 is the only variable that we measure, i.e., the mea- 
sured output of the system is 

y 

where C = [1, 0, 0, 0]^. The observability matrix of the system based on this output 
is given by 

" C^ " 

C^A 
C^A^ 

By performing the calculations, we verify that 



detP„ = 0.01 



which implies that the system is always observable from y = 9i. 
When h = I2, the system is uncontrollable. In this case, ai 
the matrix A and vector B become 



a2,l3i = 02, and 






1 













.2ai 







-O.lai 




1 


, B = 


/3i 









ai 











indicating that the control input u cannot influence the states 2:3, 2:4. It can be 
verified that for X3(0),a;4(0) 7^ 0, all the states will grow to infinity for all possible 
inputs u. For li = I2, the control of the two identical pendulums is possible provided 
the initial angles and angular velocities are identical, i.e., ^i(O) = ^2(0) and ^i(O) = 
^2(0), which imply that 2:3(0) = 2:4(0) = 0. V 
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2.3 Input/Output Models 

2.3.1 Transfer Functions 

Transfer functions play an important role in the characterization of the I/O 
properties of LTI systems and are widely used in classical control theory. 

We define the transfer function of an LTI system by starting with the 
differential equation that describes the dynamic system. Consider a system 
described by the nth-order differential equation 

y(")(t)+a„_iy("-i)(i) + - ■ ■+aoy{t) = 6„n(™)(t) + 6^_in(™-i)(t) + - ■ ■ + 6o«(t) 

(2.3.1) 
where y^^'{t) = ^y{t), and nW(f) = -l^u{t); u{t) is the input variable, 
and y{t) is the output variable; the coefficients ai,bj,i = 0, 1 . . . , n — l,j = 
0,1, ... ,m are constants, and n and m are constant integers. To obtain the 
transfer function of the system (2.3.1), we take the Laplace transform on 
both sides of the equation and assume zero initial conditions, i.e., 

(s" + a„_is"-^ + ■ • ■ + ao)Y{s) = {bms"" + ^^-is"^"^ + ■ ■ ■ + bo)U{s) 



where s is the Laplace variable. The transfer function G(s) of (2.3.1) is 
defined as 

A Y{s) ^ b^s"" + bm-lS""-^ + ■ ■ ■ + b o 

U{s) s" + o„_is"-i + • • ■ + ao 

The inverse Laplace g(t) of G(s), i.e. 



G{s) = ^= "" ^-"'-^- ^ ^^ (2.3.2) 



g{t) ^ C-'[G{.s)] 

is known as the impulse response of the system (2.3.1) and 

y{t) = g{t) * u{t) 

where * denotes convolution. When u(t) = S/\(t) where 5/\(t) is the delta 
function defined as 

Mt) = lim^(^)-^(^-^^ 



where I{t) is the unit step function, then 

y{t) = g{t) * 5A{t) = g{t) 
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Therefore, when the input to the LTI system is a delta function (often re- 
ferred to as a unit impulse) at i = 0, the output of the system is equal to 
g{t), the impulse response. 

We say that G(s) is proper if G(oo) is finite i.e., n > m; strictly proper if 
G(oo) = , i.e., n > m; and biproper if n = m. 

The relative degree n* of G(s) is defined as n* = n — m, i.e., n* = degree 
of denominator - degree of numerator of G(s). 

The characteristic equation of the system (2.3.1) is defined as the equation 
s" + a„_is"-i + . . . + ao = 0. 

In a similar way, the transfer function may be defined for the LTI system 
in the state space form (2.2.3), i.e., taking the Laplace transform on each 
side of (2.2.3) we obtain 



sX{s) - x{0) = AX{s) + BU{s 
Y{s) = C^X{s) + DU{s) 



T^.„^ , n^^/„^ (2-3.3) 



or 



Y{s) = [C^{sl - A)-^B + d) U{s) + C^{sl - A)-^x{0) 
Setting the initial conditions to zero, i.e., x(0) = we get 

Y{s) = G{s)U{s) (2.3.4) 

where 

G{s) = C^{sI-A)-^B + D 

is referred to as the transfer function matrix in the case of multiple inputs 
and outputs and simply as the transfer function in the case of SISO systems. 
We may also represent G{s) as 

^, , G^iadUsI-A)}B 

where adjQ denotes the adjoint of the square matrix Q £ TZ'^^'^. The {i,j) 
element qij of adjQ is given by 



g,, = (-l)^+^det(Q,0; i,J = l,2,.. 



n 
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where Qji £ 'JZi^~^>^(^~^) is a submatrix of Q obtained by eliminating the 
jth row and the ith column of the matrix Q. 

It is obvious from (2.3.5) that the poles of G(s) are included in the 
eigenvalues of A. We say that A is stable if all its eigenvalues lie in Re[s] < 
in which case G(s) is a stable transfer function. It follows that det(s/— ^) = 
is the characteristic equation of the system with transfer function given by 
(2.3.5). 

In (2.3.3) and (2.3.4) we went from a state-space representation to a 
transfer function description in a straightforward manner. The other way, 
i.e., from a proper transfer function description to a state-space represen- 
tation, is not as straightforward. It is true, however, that for every proper 
transfer function G(s) there exists matrices A, B, C, and D such that 

G{s) = C^{sI-A)-^B + D 

As an example, consider a system with the transfer function 

^. . ^ brnS^ + brn-is"'-' + ■ ■ ■ + bp ^ F(s) 

s" + an-is"-i + ■ ■ • + ao U{s) 

where n> m. Then the system may be represented in the controller form 



u (2.3.6) 
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y = [0,0,...,bm,---,bi,bo]x 

or in the observer form 
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(2.3.7) 



y = [i,o,...,o]x 
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One can go on and generate many different state-space representations 
describing the I/O properties of the same system. The canonical forms in 
(2.3.6) and (2.3.7), however, have some important properties that we will use 
in later chapters. For example, if we denote by (Ac, B^ Cc) and (Aq, Bq, Cq) 
the corresponding matrices in the controller form (2.3.6) and observer form 
(2.3.7), respectively, we establish the relations 

[adj(s/ - Ac)]Bc = [s"-S . . . , s, 1]^ = a„_i(s) (2.3.8) 

CjadiisI - Ao) = [s^-\ ...,s,l] = al_,is) (2.3.9) 

whose right-hand sides are independent of the coefficients of G(s). Another 
important property is that in the triples (Ac, Bc,Cc) and (Ao, Bo,Co), the 
n + m+1 coefficients of G(s) appear explicitly, i.e., (Ac,Bc,Cc) (respectively 
{Ao, Bo, Co)) is completely characterized by n + r7i,+ 1 parameters, which are 
equal to the corresponding coefficients of G(s). 

If G(s) has no zero-pole cancellations then both (2.3.6) and (2.3.7) are 
minimal state-space representations of the same system. If G(s) has zero- 
pole cancellations, then (2.3.6) is unobservable, and (2.3.7) is uncontrollable. 
If the zero-pole cancellations of G(s) occur in Re[s] < 0, i.e., stable poles are 
cancelled by stable zeros, then (2.3.6) is detectable, and (2.3.7) is stabilizable. 
Similarly, a system described by a state-space representation is unobservable 
or uncontrollable, if and only if the transfer function of the system has zero- 
pole cancellations. If the unobservable or uncontrollable parts of the system 
are asymptotically stable, then the zero-pole cancellations occur in Re[s] < 0. 

An alternative approach for representing the differential equation (2.3.1) 
is by using the differential operator 

which has the following properties: 

(i) p(x) = x; ill) p(xy) = xy + xy 

where x and y are any differentiable functions of time and x = -^|^ . 

The inverse of the operator p denoted by p~^ or simply by - is defined 
as 

-ix) = f x(T)dT + x(0) Vt > 
P Jo 
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where x{t) is an integrable function of time. The operators p, - are related 
to the Laplace operator s by the following equations 

'CMx)}|^(0)=o = ■5-^(«) 

^{-(x)} U(o)=o= -^(s) 
p ^ ' s 

where C is the Laplace transform and x{t) is any differentiable function of 

time. Using the definition of the differential operator, (2.3.1) may be written 

in the compact form 

R{p){y) = Z{p){u) (2.3.10) 

where 

R{p) = p" + a„_ip"-i + ■ ■ ■ + ao 

Z{p) = b^p^ + hm-ip'^-^ + ■ ■ ■ + 6o 

are referred to as the polynomial differential operators [226]. 
Equation (2.3.10) has the same form as 

R{s)Y{s) = Z{s)U{s) (2.3.11) 

obtained by taking the Laplace transform on both sides of (2.3.1) and as- 
suming zero initial conditions. Therefore, for zero initial conditions one can 
go from representation (2.3.10) to (2.3.11) and vice versa by simply replacing 
s with p or p with s appropriately. For example, the system 

Yis) = ^Uis) 
s^ + ao 

may be written as 

(p2 + ao)(y) = (p + feo)(«) 

with y(0) = y(0) = 0, u(0) = or by abusing notation (because we never 

defined the operator (p^ + ao)~^) as 

yy^> = ^- — ^(^) 

P +0.0 

Because of the similarities of the forms of (2.3.11) and (2.3.10), we will use 
s to denote both the differential operator and Laplace variable and express 
the system (2.3.1) with zero initial conditions as 
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where y and u denote Y(s) and U(s), respectively, when s is taken to be the 
Laplace operator, and y and u denote y(t) and u(t), respectively, when s is 
taken to be the differential operator. 

We will often refer to G{s) = -pv^ in (2.3.12) as the filter with input u{t) 
and output y(t). 

Example 2.3.1 Consider the system of equations describing the motion of the cart 
with the two pendulums given in Example 2.2.1, where y = 6i is the only measured 
output. Eliminating the variables 61^62, and 62 by substitution, we obtain the 
fourth order differential equation 

y^ ' — 1.1(q!i + a2)y + 1.2aia2y = Piu^ ' — ai(32U 

where a^, /3i, z = 1,2 are as defined in Example 2.2.1, which relates the input u with 
the measured output y. 

Taking the Laplace transform on each side of the equation and assuming zero 
initial conditions, we obtain 

[s^ - l.l(ai + a2)s^ + l.2aia2]Y{s) = {f3is'^ - aif32)U{s) 

Therefore, the transfer function of the system from u to y is given by 

Y{s) f3is^ - ai/32 



U{s) s4- I.l(ai + a2)s2 + 1.2aia2 
For li = I2, we have ai = 012, /9i = [32, and 



G{s) 



G{s) 



s4 - 2.2ais2 + 1.2a^ (s2 - ai){s'^ - 1.2ai) 



has two zero-pole cancellations. Because ai > 0, one of the zero-pole cancellations 
occurs in Re[s] > which indicates that any fourth-order state representation of 
the system with the above transfer function is not stabilizable. V 

2.3.2 Coprime Polynomials 

The I/O properties of most of the systems studied in this book are repre- 
sented by proper transfer functions expressed as the ratio of two polynomials 
in s with real coefficients, i.e., 

G(,,) = II (2,3,13) 
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where Z{s) = bms"^ + 6™-is™-^ + ■ ■ ■ + 60, R{s) = s" + a„_is"-i + ■ ■ ■ + gq 
and n > m. 

The properties of the system associated with G{s) depend very much 
on the properties of Z{s) and R(s). In this section, we review some of 
the general properties of polynomials that are used for analysis and control 
design in subsequent chapters. 

Definition 2.3.1 Consider the polynomial X(s) = UnS^ + an-is"'~^ + • • • + 
aQ. We say that X(s) is monic if an = 1 and X{s) is Hurwitz if all the 
roots of X{s) = are located in Re[s] < 0. We say that the degree of X{s) 
is n if the coefficient a-n of s" satisfies an ^ 0- 

Definition 2.3.2 A system with a transfer function given by (2.3.13) is 
referred to as minimum phase if Z{s) is Hurwitz; it is referred to as stable 
if R{s) is Hurwitz. 

As we mentioned in Section 2.3.1, a system representation is minimal 
if the corresponding transfer function has no zero-pole cancellations, i.e., if 
the numerator and denominator polynomials of the transfer function have 
no common factors other than a constant. The following definition is widely 
used in control theory to characterize polynomials with no common factors. 

Definition 2.3.3 Two polynomials a{s) and h{s) are said to he coprime (or 
relatively primej if they have no common factors other than a constant. 

An important characterization of coprimeness of two polynomials is given 
by the following Lemma. 

Lemma 2.3.1 (Bezout Identity) Two polynomials a{s) and h{s) are co- 
prime if and only if there exist polynomials c{s) and d{s) such that 

c{s)a{s) + d{s)b{s) = 1 

For a proof of Lemma 2.3.1, see [73, 237]. 

The Bezout identity may have infinite number of solutions c(s) and d{s) 
for a given pair of coprime polynomials a{s) and b{s) as illustrated by the 
following example. 
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Example 2.3.2 Consider the coprime polynomials a{s) = s+l,6(s) = s + 2. Then 
the Bezout identity is satisfied for 

c(s) = s" + 2s"-i-l, d(s) = -s" - s"-i + 1 
and any n > 1. V 

Coprimeness is an important property that is often exploited in control 
theory for the design of control schemes for LTI systems. An important the- 
orem that is very often used for control design and analysis is the following. 

Theorem 2.3.1 If a(s) and b(s) are coprime and of degree Ha and rib, i~e- 
spectively, where ria > n^, then for any given arbitrary polynomial a*{s) of 
degree ria* > ria, the polynomial equation 

a{s)l{s) + b{s)p{s) = a*{s) (2.3.14) 

has a unique solution l{s) and p(s) whose degrees rii and rip, respectively, 
satisfy the constraints rip < na,ni < max(na* — ria, rib — !)• 

Proof From Lemma 2.3.1, there exist polynomials c(s) and d{s) such that 

a{s)c{s) + b{s)d{s) = 1 (2.3.15) 

Multiplying Equation (2.3.15) on both sides by the polynomial a*{s), we obtain 

a*{s)a{s)c{s) + a* {s)b{s)d{s) = a*{s) (2.3.16) 

Let us divide a*{s)d{s) by a{s), i.e., 

a{s) a(s) 

where r(s) is the quotient of degree n^. + nj^ — Ua] ria' , Ua, and rij^ are the degrees 
of a*{s),a{s), and d{s), respectively, and p{s) is the remainder of degree Up < Ua- 
We now use 

a*{s)d{s) = r{s)a{s) + p{s) 

to express the right-hand side of (2.3.16) as 

a* {s)a{s)c{s) + r{s)a{s)b{s) + p{s)b{s) = [a*{s)c{s) + r{s)b{s)]a{s) + p{s)b{s) 
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and rewrite (2.3.16) as 

l{s)a{s) + p{s)b{s) = a*{s) (2.3.17) 

where l{s) = a*{s)c{s) + r{s)b{s). The above equation impUes that the degree of 
l{s)a{s) = degree of (o*(s) — p{s)b{s)) < max{na., rip + Uf,}. Hence, the degree 
of l{s), denoted by ni, satisfies ni < niax{na. — na,np + rit — J^a}• We, therefore, 
established that polynomials l{s) and p{s) of degree ni < max{na. — Ua^Up + 
^b — Tia] and Up < Ha respectively exist that satisfy (2.3.17). Because Up < n^ 
implies that Up < Ha — I, the degree n; also satisfies ni < max{n* — na,nh — 1}. 
We show the uniqueness of l{s) and p{s) by proceeding as follows: We suppose 
that (Zi(s),pi(s)), {l2{s),p2{s)) are two solutions of (2.3.17) that satisfy the degree 
constraints Hp < na,ni < maxjna. — na,nf, — 1}, i.e., 

a{s)li{s) + b{s)pi{s) = a*{s), a{s)l2{s) + b{s)p2{s) = a*{s) 

Subtracting one equation from another, we have 

a{s){h{s) - his)) + b{s){pi{s) - p2{s)) = (2.3.18) 

which implies that 

^ , h^zM± p.,19) 

a{s) pi{s)-p2{s) 

Because Hp < Ua, equation (2.3.19) implies that b{s), a{s) have common factors that 
contradicts with the assumption that a{s) and b{s) are coprime. Thus, li{s) = l2{s) 
and pi{s) = P2{s), which implies that the solution l{s) and p{s) of (2.3.17) is unique, 
and the proof is complete. D 

If no constraints are imposed on the degrees of l(s) and p{s), (2.3.14) has 
an infinite number of solutions. Equations of the form (2.3.14) are referred 
to as Diophantine equations and are widely used in the algebraic design 
of controllers for LTI plants. The following example illustrates the use of 
Theorem 2.3.1 for designing a stable control system. 

Example 2.3.3 Let us consider the following plant 

y=?^^—u (2.3.20) 

We would like to choose the input u{t) so that the closed-loop characteristic equation 
of the plant is given by a*{s) = (s+l)^, i.e., u is to be chosen so that the closed-loop 
plant is described by 

[s+l)^y = (2.3.21) 
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Let us consider the control input in the form of 

p{s) 



l{s[ 



-y 



(2.3.22) 



where l{s) and p{s) are polynomials with real coefficients whose degrees and coef- 
ficients are to be determined. Using (2.3.22) in (2.3.20), we have the closed-loop 
plant 

s^l{s)y = -{s- l)p{s)y 

i.e., 

[l{s)s^ + p{s){s - l)]y = 

If we now choose l{s) and p{s) to satisfy the Diophantine equation 

l{s)s^+p{s){s-l) = {s + lf (2.3.23) 

then the closed-loop plant becomes the same as the desired one given by (2.3.21). 
Because (2.3.23) may have an infinite number of solutions for l{s),p{s), we 
use Theorem 2.3.1 to choose l{s) and p{s) with the lowest degree. According to 
Theorem 2.3.1, Equation (2.3.23) has a unique solution l{s),p{s) of degree equal to 
at most 2. Therefore, we assume that l{s),p(s) have the form 

l{s) = l^s'^ + hs + lo 

p{s) =P2S^ +P1S + P0 

which we use in (2.3.23) to obtain the following polynomial equation 

hs^ + llS'^+{l0+P2)s^ + {Pl-P2)s^ + {Pf)-Pl)s-pf) = S^ ^hs'^ +IQS^ +ms^ + hs+l 

Equating the coefficients of the same powers of s on each side of the above equation, 
we obtain the algebraic equations 

i l2 = l 

h + P2 = 10 

Pl-P2= 10 

Po - Pi = 5 
-Po = 1 



which have the unique solution of I2 = l,/i = 5,/o = 26, P2 = ~16,Pi = — 6,Po 
— 1. Hence, 



l{s) = s^ + bs + 2Q, p{s) = 
and from (2.3.22) the control input is given by 



-16s' 



6s- 1 
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16s2 + 6s+ 1 

u = —^ y 

s2 + 5s + 26 



V 



Another characterization of coprinieness that we use in subsequent chap- 
ters is given by the following theorem: 



Theorem 2.3.2 (Sylvester's Theorem) Two polynomials a{s) 



ans"- + 



a-n-is 



n-l 



+ 



+ aQ, b{s) = bns"" + 6„_is"~ + ■ ■ ■ + 6o are coprime if and 
only if their Sylvester matrix Se is nonsingular, where Sg is defined to be the 
following 2n x 2n matrix: 



S, 



ttn 



«n-l «r; 



ai 




ao 


ai 





ao 















bn 











bn-1 bn 









■ bn-l 


bn 





an 
a-n-i 



bi 
bo 





bi 

bo 




oo 




ai 
ao 



















bn 

bn-l 



bo bi 
bo 

(2.3.24) 



Proof If Consider the following polynomial equation 

a{s)c{s) + b{s)d{s) = 1 



(2.3.25) 



where c(s) = c„_is" i + c„_2s" ^H hco, d(s) = d„_is" i + d„_2s" ^H \-do 

are some polynomials. Equating the coefficients of equal powers of s on both sides 
of (2.3.25), we obtain the algebraic equation 



SeP = ein 
where ein = [0, 0, . . . , 0, 1]^ and 

P= [Cn-l, C„_2, . . . ,Co,(in-l,dn-2, 



(2.3.26) 



A^V 
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Equations (2.3.25) and (2.3.26) are equivalent in the sense that any solution of 
(2.3.26) satisfies (2.3.25) and vice versa. Because Sg is nonsingular, equation (2.3.26) 
has a unique solution for p. It follows that (2.3.25) also has a unique solution for 
c(s) and d{s) which according to Lemma 2.3.1 implies that a(s),6(s) are coprime. 

Only if We claim that if a(s) and b{s) are coprime, then for all nonzero polynomials 
p(s) and q{s) of degree Up < n and Uq < n, respectively, we have 

a{s)p{s) + b{s)q{s) ^ (2.3.27) 

If the claim is not true, there exists nonzero polynomials pi{s) and qi{s) of degree 
Up-^ < n and n^^ < n, respectively, such that 

a{s)pi{s) + b{s)qi{s) = (2.3.28) 

Equation (2.3.28) implies that b{s)/a{s) can be expressed as 

b{s) ^ Pi{s) 
a{s) qi{s) 

which, because rip^ < n and rig^ < n, implies that a{s) and b{s) have common 
factors, thereby contradicting the assumption that a{s),b{s) are coprime. Hence, 
our claim is true and (2.3.27) holds. 
Now (2.3.27) may be written as 

SeX / (2.3.29) 

where x G TZ^" contains the coefficients oi p{s),q{s). Because (2.3.27) holds for all 
nonzero p{s) and q{s) of degree Up < n and nq < n, respectively, then (2.3.29) holds 
for all vectors x G 7^^" with x ^ 0, which implies that Se is nonsingular. D 

The determinant of Se is known as the Sylvester resultant and may be 
used to examine the coprimeness of a given pair of polynomials. If the 
polynomials a(s) and b(s) in Theorem 2.3.2 have different degrees — say n^ < 
Ua — then 6(s) is expressed as a polynomial of degree Ua by augmenting it 
with the additional powers in s whose coefficients are taken to be equal to 
zero. 

Example 2.3.4 Consider the polynomials 

a{s) = s^ + 2s + 1, 6(s) = s- 1 = Os^ + s- 1 
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Their Sylvester matrix is given by 



Se 



10 
2 11 
12-11 
10-1 



Because detS'e = 4 7^ 0, a{s) and b{s) are coprime polynomials. 



V 



The properties of the Sylvester matrix are useful in solving a class of 
Diophantine equations of the form 

l{s)a{s) +p{s)b{s) = a*{s) 

for l(s) and p(s) where a(s),6(s), and a*{s) are given polynomials. 

For example, equation a{s)l(s) + b{s)p{s) = a*(s) with n^ = n,na* = 
2n — 1, and rif, = m < n implies the algebraic equation 



SeX = f 



(2.3.30) 



where Sp ^ TZ 



2nx2n 



is the Sylvester matrix of a{s),b{s), and x £ 7Z is a 



vector with the coefficients of the polynomials l(s) and p(s) whose degree 
according to Theorem 2.3.1 is at most n — 1 and / £ 7?.^" contains the 
coefficients of a*(s). Therefore, given a*(s),a(s), and b(s), one can solve 
(2.3.30) for X, the coefficient vector of l{s) and p{s). If a{s), b{s) are coprime, 
S~^ exists and, therefore, the solution of (2.3.30) is unique and is given by 

X = S-'f 

If a(s),6(s) are not coprime, then Se is not invertible, and (2.3.30) has a 
solution if and only if the vector / is in the range of Se- One can show through 
algebraic manipulations that this condition is equivalent to the condition 
that a*(s) contains the common factors of a{s) and b(s). 

Example 2.3.5 Consider the same control design problem as in Example 2.3.3, 
where the control input u = —jrjly is used to force the plant y = ^jg-u to satisfy 
(s + l)^y = 0. We have shown that the polynomials l{s) and p{s) satisfy the 
Diophantine equation 

l{s)a{s) + p{s)b{s) = {s + if (2.3.31) 



2.4. PLANT PARAMETRIC MODELS 



47 



1. The corresponding Sylvester matrix Se of a{s) 



1 




















1 




















1 


1 

















-1 


1 

















-1 


1 

















-1 



where a{s) = s^ and b{s) 
and b{s) is 



Se 



Because detSe = —1, we verify that a{s),b{s) are coprime. 

As in Example 2.3.3, we like to solve (2.3.31) for the unknown coefficients 
li, Pi, i = 0,1,2 oi the polynomials l{s) = l2s'^ + hs + Iq and p{s) = P2s'^ + pis + po- 
By equating the coefficients of equal powers of s on each side of (2.3.31), we obtain 
the algebraic equation 

SeX = f (2.3.32) 

where / = [1, 5, 10, 10, 5, 1]^ and x = [I2, h, lo,P2,Pi,Po]^ ■ Because Se is a nonsin- 
gular matrix, the solution of (2.3.32) is given by 

cc = ^7V= [1,5,26,-16,-6,-1,]^ 

which is the same as the solution we obtained in Example 2.3.3 (verify!). \7 



2.4 Plant Parametric Models 

Let us consider the plant represented by the following minimal state-space 

form: 

X = Ax + Bu, x(0) = xo 
y = C^ X 



(2.4.1) 



where x £ TZ"',u £ TZ^, and y £ TZ^ and A,B, and C have the appropriate 
dimensions. The triple {A,B,C) consists of n^+2n elements that are referred 
to as the plant parameters. If (2.4.1) is in one of the canonical forms studied 
in Section 2.2.2, then n^ elements of {A,B,C) are fixed to be or 1 and at 
most 2n elements are required to specify the properties of the plant. These 
2n elements are the coefficients of the numerator and denominator of the 
transfer function jrfx. For example, using the Laplace transform in (2.4.1), 



we obtain 



U{s) 



Y{s) = C^{sl - A)-^BU{s) + C^{,sl - A)- 



Xq 
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which imphes that 

where R{s) is a polynomial of degree n and Z(s) of degree at most n — 1. 
Setting xo = 0, we obtain the transfer function description 

Z(s) 

where without loss of generality, we can assume Z(s) and R{s) to be of the 
form 

Z(s) = fe„_is"-i + 6„_2s"-2 + ... + 6is + 6o (2.4.4) 

R(s) = s" + a„_is""^ + ••• + ais + ao 

If Z{s) is of degree m < n—1, then the coefficients bi,i = n— l,n— 2, . . . , m+1 
are equal to zero. Equations (2.4.3) and (2.4.4) indicate that at most 2n 
parameters are required to uniquely specify the I/O properties of (2.4.1). 
When more than 2n parameters in (2.4.3) are used to specify the same I/O 
properties, we say that the plant is overparameterized. For example, the 
plant 

y= -^ir^u (2.4.5 

^ R{s)A{s) ^ ' 

where A(s) is Hurwitz of arbitrary degree r > 0, has the same I/O properties 
as the plant described by (2.4.3), and it is, therefore, overparameterized. In 
addition, any state representation of order n + r > n of (2.4.5) is nonminimal. 

For some estimation and control problems, certain plant parameteriza- 
tions are more convenient than others. A plant parameterization that is 
useful for parameter estimation and some control problems is the one where 
parameters are lumped together and separated from signals. In parameter 
estimation, the parameters are the unknown constants to be estimated from 
the measurements of the I/O signals of the plant. 

In the following sections, we present various parameterizations of the 
same plant that are useful for parameter estimation to be studied in later 
chapters. 
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2.4.1 Linear Parametric Models 

Parameterization 1 

The plant equation (2.4.3) may be expressed as an nth-order differential 
equation given by 

y(") + a„_iy("-^) + . . . + aoy = 6„_i«("-i) + &„_2n("-2) + --- + bou (2.4.6) 

If we lump all the parameters in (2.4.6) in the parameter vector 

0* = [bn-i,bn-2, ■ ■ ■ ,bo, a„_i, an-2, • • • , oo] 

and all I/O signals and their derivatives in the signal vector 

Y = [n("-i),n(«-2),...,n,-y("-^),-y(«-2),...,-y]^ 
= [a^_i(s)n,-a^_i(s)y]^ 

, 1] , we can express (2.4.6) and, therefore, (2.4.3) 
y{n) ^ 0*Ty (2.4.7) 



A 



i „i—l 



S\.S 



where ai(s] 

in the compact form 



Equation (2.4.7) is linear in 9*, which, as we show in Chapters 4 and 5, is 
crucial for designing parameter estimators to estimate 6* from the measure- 
ments of y'"-* and Y. Because in most applications the only signals available 
for measurement is the input u and output y and the use of differentiation 
is not desirable, the use of the signals y*-"' and Y should be avoided. One 
way to avoid them is to filter each side of (2.4.7) with an nth-oidei stable 



filter -TTT to obtain 
A(s) 



where 



A 1 



Ms. 



■y 



3*T , 



(n) 



(2.4.. 



A(. 



■y 



A 






-,T 



and 



Ms) ' A(^) 
A(s) = s" + A„_is"-i + ■ • • + Ao 
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is an arbitrary Hurwitz polynomial in s. It is clear that the scalar signal z and 
vector signal (f> can be generated, without the use of differentiators, by simply 
filtering the input u and output y with stable proper filters jnj), i = 0, 1, . . . n. 
If we now express A(s) as 

A(s) = s" + A^a„_i(s) 

where A = [A„_i, Xn-2, • • • , Aq]^, we can write 

A(s) - A^a„_i(s) 



Hs] 



y 



Hs) 



jOn-lis) 

v = y->^ -^TT^—y 



Hs) 



Therefore, 



^an-iis) 



Because z = 6*'^ (p = ^i"'"'^! + ^2^<^2, where 

^1 = [bn-l, bn-2, • • • , ^o] ) 02 = [«n-l, an-2, • • • , Oo] 

, A an-i{s) A an-i(s) 
n = — ry-^W' 92 = rj-^y 



Hs) 



Hs) 



it follows that 



y = ef<pi + efcP2 - x^h 



Hence, 

y = ei'^P (2.4.9) 

where 0*^ = [Of^ ,92~^ - A^]^. Equations (2.4.8) and (2.4.9) are represented 
by the block diagram shown in Figure 2.2. 

A state-space representation for generating the signals in (2.4.8) and 
(2.4.9) may be obtained by using the identity 



[adj(s/- Ac)]^ = a„-i(s) 



where Ac, / are given by 



A, 



"An-l —Xn-2 
1 



-Ao 




1 
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u 



an-i(s) 



A{s) 




Figure 2.2 Plant Parameterization 1. 



which imphes that 



det(s/ - Ae) = A(s), {si - Ac)-^l - """i^"') 



Ms) 



Therefore, it follows from (2.4.8) and Figure 2.2 that 



'1 = 


= Ac(f>i + lu, 


(pi^n 


'2 = 


= Ac(/)2 - ly, 


4>2^n 


y = 


- of<p 




z = 


= y + X^4>2 = 


0*^(j) 



(2.4.10) 



Because A(s) = det(s/ — A^) and A(s) is Hurwitz, it follows that Ac is a 
stable matrix. 

The parametric model (2.4.10) is a nonminimal state-space representa- 
tion of the plant (2.4.3). It is nonminimal because 2n integrators are used 
to represent an nth-order system. Indeed, the transfer function Y(s)/U{s) 
computed using (2.4.10) or Figure 2.2, i.e., 

Y{s) _ Z{s) A(s) _ Z{s) 
U{s) ~ R(s)A(s) ~ R(^ 

involves n stable zero-pole cancellations. 

The plant (2.4.10) has the same I/O response as (2.4.3) and (2.4.1) 
provided that all state initial conditions are equal to zero, i.e., xq = 0, 
0i(O) = (?f)2(0) = 0. In an actual plant, the state x in (2.4.1) may represent 
physical variables and the initial state xq may be different from zero. The 
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effect of the initial state xq may be accounted for in the model (2.4.10) by 
applying the same procedure to equation (2.4.2) instead of equation (2.4.3). 
We can verify (see Problem 2.9) that if we consider the effect of initial con- 
dition xo, we will obtain the following representation 

01 = Ac(pi + lu, 0i(O) = O 
Ac4>2 - ly, 02(0) = 



^2 



y = Ol'cp + Tjo (2.4.11) 

z = y + \^ 4>2 = 0*^ 4> + rjo 



where r]o is the output of the system 



% = C^oo (2.4.12) 

where uj £ 7U\ojq = BqXq and Cq G 7U'',Bq e Jinxn ^^^ constant matrices 
that satisfy Cj {&di{sl - Ac)}Bo = C^{adj(s/ - A)}. 

Because Ac is a stable matrix, it follows from (2.4.12) that u, rjQ converge 
to zero exponentially fast. Therefore, the effect of the nonzero initial condi- 
tion xq is the appearance of the exponentially decaying to zero term 770 in 
the output y and z. 

Parameterization 2 

Let us now consider the parametric model (2.4.9) 

y = B*^<t> 

and the identity Wm{s)W^^{s) = 1, where Wm{s) = Z„i{s) / Rm{s) is a 
transfer function with relative degree one, and Zm{s) and Rm{s) are Hurwitz 
polynomials. Because 0\ is a constant vector, we can express (2.4.9) as 

y = Wm{s)9fW-\s)<p 

If we let 



^^ 



Wm{s) 



Wm{s)A{sf' W^{s)A{sf 
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A{s)WUs) 




















A^ 















Figure 2.3 Plant Parameterization 2. 



we have 



y = Wm{s)efiJ 



(2.4.13) 



Because all the elements of 
stable poles, the state tp 






are proper transfer functions with 



[ipj jtpjf ^ where 



, an-i(s) , 

Wm{s)A{s) 



«n-l(s) 
'Wrr,{s)A{s) 



y 



can be generated without differentiating y or u. The dimension of ^p depends 
on the order n of A(s) and the order of Zm{s). Because Zm{s) can be 
arbitrary, the dimension of ip can be also arbitrary. 

Figure 2.3 shows the block diagram of the parameterization of the plant 
given by (2.4.13). We refer to (2.4.13) as Parameterization 2. In [201], 
Parameterization 2 is referred to as the model reference representation and 
is used to design parameter estimators for estimating 9\ when Wm{s) is a 
strictly positive real transfer function (see definition in Chapter 3). 

A special case of (2.4.13) is the one shown in Figure 2.4 where 



Wm{s) 



and (s + Ao) is a factor of A(s), i.e.. 



1 



s + \. 



A(s) = {s + Ao)Ag(s) = s" + A„_is" ' + ••• + Ao 



where 



A,(s) 



s" ^ + g„_2s" 2 + --- + gis + l 



54 



CHAPTER 2. MODELS FOR DYNAMIC SYSTEMS 



Us) 



V'l 



9f 



-^(s 



ri+ 



s+Ao 



9f 



V'2 



-an~i{s) 



Figure 2.4 Plant Parameterization 2 witli A(s) = (s + Ao)Aq(s) and 



The plant Parameterization 2 of Figure 2.4 was first suggested in [131], 
where it was used to develop stable adaptive observers. An alternative para- 
metric model of the plant of Figure 2.4 can be obtained by first separating 
the biproper elements of 



an-ijs) 



as follows: 



A 



For any vector c = [c„_i, c„_2, • • • , ci, cq] G 7?.", we have 



A,(5) 



A,(s) 



A,(s) 



(2.4.14) 



where c = [c„_2, . • . , ci, co]^, a„_2 = [s" ^,...,s,l]^. Because Ag(s) 



„n-l 



=7T 



+ q a„_2(s), where g' = [qn-2, . . . , Q'l, 1] , we have s 



n-l 



q an-2, 



which after substitution we obtain 



c^a„_i(s) 



Cn-l + 



(c-c„_iQ')^a„_2(s) 



A,(^) 



(2.4.15) 



A,(.) — ' A,(s) 

We use (2.4.15) to obtain the following expressions: 

Ag(s) Aq(s) 

-(^2 -^ J^r^-rV = [K-i - an-i)y - O2 j/ (2.4.16) 



A,(s) 



A,(5) 



where 0J^ 



6 - br,-^c|, 6%^ = a - X - (a„_i - A„_i)g and a = [a„_2, 



n-iy) "^2 

. . ., ai, ao]^, 6 = [&„-i, . . . , &i, 6o]^, A = [A„_2, . • . , Ai, Aq]^. Using (2.4.16) 
Figure 2.4 can be reconfigured as shown in Figure 2.5. 
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a«-2(g) 



V'l 



9f 



M-1 



-^ 



1 



s+Xo 



xi = y 



w 



1p2 



-an-2{s) 



^n— 1 0,n—l 



Figure 2.5 Equivalent plant Parameterization 2. 

A nonminimal state space representation of the plant follows from Fig- 
ure 2.5, i.e., 



Xl 

y 

3*T 



-AoSi + r^v, ^1 e ^^ 



AcV'2 - ly, 

Xl 






(2.4.17) 



where 9* = [bn-i,9*i , A„_i - a„_i, ^2 ] , V' = [■", V'l , y, V'2 ] and 



",T „, J.TiT 



A. 



-9n-2 —Qn-S ■ ■ ■ —go 

1 ••• 



I 



1 






•••10 

As with Parameterization 1, if we account for the initial condition x(0) = 
xo / 0, we obtain 

^1 = -AoXi + r'^V', xi(0)=0 

V^i = AcV'l + lu, V'i(O) = 

V^s = A,V^2-^"y, V^2(0) = (2.4.18) 

y = Xl + r/o 

where r]Q is the output of the system 

to = AcU), uj{0) = (jjQ, CO E 7V^ 
rjQ = CqU) 
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where Ac, Cq, and l^o are as defined in (2.4.12). 

Example 2.4.1 (Parameterization 1) Let us consider the differential equation 

2/^''^ + a2y'^^ + aoy = 62"^^^ + ^o" (2.4.19) 

that describes the motion of the cart with the two pendulums considered in Exam- 
ples 2.2.1, 2.3.1, where 

02 = -l.l(ai + a2), flo = l-2aia2, h = (3i, 60 = -ai/32 

Equation (2.4.19) is of the same form as (2.4.6) with n = 4 and coefficients 03 = 
fli = 63 = 61 = 0. Following (2.4.7), we may rewrite (2.4.19) in the compact form 

yW = 0*-rY„ (2.4.20) 

where 9'q = [62, bo, 02, ag]^, ^0 = [" , w, —y^\ —y]^- Because y and u are the only 
signals we can measure, y^^\YQ are not available for measurement. 

If we ffiter each side of (2.4.20) with the ffiter ^^, where A(s) = (s + 2)'' = 

s"" + Ss^ + 24s2 + 32s + 16, we have 

z = e*'^^o (2.4.21) 

where z = jj^y,(l)n = [(^^w, (iq^w, - (4^y, --(jq^yj are now signals 
that can be generated from the measurements of y and u by filtering. Because in 
(2.4.19) the elements 03 = ai = 63 = 61 = 0, the dimension of ^q, (pg is 4 instead of 
8, which is implied by (2.4.8). 

Similarly, following (2.4.9) we have 

y = 0*x^4> (2.4.22) 

where 

dl = [0, 62, 0, 60, -8, 02 - 24, -32, ao - 16]^ 



"!(«) „, "J(s) 



1^^-7-T^^y 



T 

: "3(5) = [S^,S^,S,1] 



.(s + 2)4 ' (s + 2)4^ 
elements of 6'^ that do not depend on the parameters of (2.4.19) to obtain 

y = ^OA 00 + hj(f) 

where 0*^ = [62,60,02 - 24, Oq - 16]^, /iq = [0,0,0,0,-8,0,-32,0]^. We obtain a 
state-space representation of (2.4.21) and (2.4.22) by using (2.4.10), i.e., 

01 = Ac0i -I- lu, (pi e U^ 

<j>2 = Ac(t>2 - ly, 4'2 e W^ 

y = 9i^<p = eil<t>o + hJ<j> 

z = 6*0^(^0 
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where 



A, 



-8 -24 -32 -16 
10 

10 

10 



10 

10 

10 

1 



and (f> = [(f)J , (pj] ■ Instead of (2.4.22), we can also write 

y = Oo^<Po - A^02 



where A= [8,24,32,16]" 



V 



Example 2.4.2 (Parameterization 2) Consider the same plant as in Exam- 
ple 2.4.1, i.e., 

y = oU^ 

where 6**^ = [0, 62, 0, 6o, -8, 02 - 24, -32, oq - 16], 



Now we write 



where 



L(s + 2)4"' (s + 2)4^. 



6*^i^ 



s + 2 



V 



A 






L(s + 2)3 ' (s + 2)3 



Using simple algebra, we have 
(s + 2)3 " (s + 2)3 



r s3 1 




1 " 


2 

s 







s 







1 








(s + 2)3 



-6 -12 -8 

1 

1 

1 



"2(5) 



where 02(5) = [s^,s, 1]^. Therefore, ^p can be expressed as 



v- 



u — \ 



-J 0:2(3) aj(s) ^-r 02(5) al{s) 



(s + 2)3 '(s + 2): 



ru, -y + A 



■ y' 



(s + 2)3"' (5 + 2)3- 
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where A = [6, 12, 8]^, and O'^ip can be expressed as 



ei'i, 



V' 



where 



0* = [62, 0, 60, 8, a2 + 24, 64, oq + 48]" 



V- 



(s + 2)a 



■ u,y, 



■(s + 2)3 



Therefore, 



y 



^ r^V' 



s + 2 



A state-space realization of (2.4.24) is 



Xi 

i>2 
y 



-2xi+e*^ ij}, xieTC 



where V = [ipj ,y,ipJY , 



An 



Acipi + lu, 
AcV'2 - ly, 

Xi 



-6 -12 -8 
1 
1 



ip2en^ 



(2.4.23) 



(2.4.24) 



V 



2.4.2 Bilinear Parametric Models 



Let us now consider the parameterization of a special class of systems ex- 
pressed as 

(2.4.25) 



, Zo{s) 
i?o(s) 



where ko is a scalar, Ro{s) is monic of degree n, and Zo{s) is monic and 
Hurwitz of degree m < n. In addition, let Zq(s) and Ro{s) satisfy the 
Diophantine equation 



where 



koZo{s)P{s) + Ro{s)Q{s) = Zo{s)A{s) 



(2.4.26) 
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P(s) =p^an-i{s) 

a,{s) = [s\s'-\...,s,l]'^ 

q £ 7^"~^,p e 7^" are the coefficient vectors of Q{s) — s"'~^, P{s), respec- 
tively, and A(s) is a nionic Hurwitz polynomial of degree 2n — m — 1. The 
Diophantine equation (2.4.26) relating Zo{s) , Ro{s) , ko to P(s),Q(s), and 
A{s) arises in control designs, such as model reference control, to be dis- 
cussed in later chapters. The polynomials P{s) and Q{s) are usually the 
controller polynomials to be calculated by solving (2.4.26) for a given A(s). 
Our objective here is to obtain a parameterization of (2.4.25), in terms of 
the coefficients of P(s) and Q{s), that is independent of the coefficients of 
Zo(s) and Ro{s). We achieve this objective by using (2.4.26) to eliminate 
the dependence of (2.4.25) on Zo{s) and i?o(s) as follows: 
From (2.4.25), we obtain 

Qis)Rois)y = koZois)Qis)u (2.4.27) 

by rewriting (2.4.25) as Ro{s)y = /co^o(s)u and operating on each side by 
Q{s). Using Q{s)Ro{s) = Zo{s){A{s) - koP{s)) obtained from (2.4.26) in 
(2.4.27), we have 

Zo(s)(^(s) - koPis))y = koZois)Qis)u (2.4.28) 

Because Zq{s) is Hurwitz, we ffiter each side of (2.4.28) by ^ ,. to obtain 

A(.s)y = koP(.s)y + koQis)u (2.4.29) 

and write (2.4.29) as 

A{s)y = ko[p^ an-i{s)y + q^ an-2{s)u + s''-\] (2.4.30) 

We now have various choices to make. We can ffiter each side of (2.4.30) 
with the stable ffiter -r^ and obtain 

A{s) 



y 



P ./ N y + q — .. . u + 



A{s)" " A{s) A{s) 

which may be written in the compact form 

y = ko{e*^(P + zo) (2.4.31) 
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T ^TlT 






and zq = ^^r^u. We can 



where e* = [q\p i ,^^ - a(s) "' ^4(ir 

also filter each side of (2.4.30) using an arbitrary stable filter jj-^ whose 

order nx satisfies 2n — m — l>nx>n— Ito obtain 

y = W{s)ko{e*^cP + zo) (2.4.32) 



where now 



^0 = X(iy^' ^^"^ ^(^) = ^ is ^ 



A(s) "' A(s) y 

proper transfer function. 

In (2.4.31) and (2.4.32), and zq may be generated by filtering the input 
u and output y of the system. Therefore, if u and y are measurable, then 
all signals in (2.4.31) and (2.4.32) can be generated, and the only possible 
unknowns are ko and 6*. If /cq is known, it can be absorbed in the signals (j) 
and zq, leading to models that are affine in 6* of the form 

y = W{s)9*^^ (2.4.33) 

where y = y — W(s)kQZ, (p = kQ(f). If k^, however, is unknown and is part 
of the parameters of interest, then (2.4.31) and (2.4.32) are not affine with 
respect to the parameters ko and 6*, but instead, ko and 9* appear in a 
special bilinear form. For this reason, we refer to (2.4.31) and (2.4.32) as 
bilinear parametric models to distinguish them from (2.4.7) to (2.4.9) and 
(2.4.33), which we refer to as linear parametric or affine parametric models. 
The forms of the linear and bilinear parametric models are general enough 
to include parameterizations of some systems with dynamics that are not 
necessarily linear, as illustrated by the following example. 

Example 2.4.3 Let us consider the nonlinear scalar system 

x = aof{x,t) + bog{x,t) + cou (2.4.34) 

where ao,6oi and cq are constant scalars; f{x,t) and g{x,t) are known nonlinear 
functions that can be calculated at each time t; and u, x is the input and state of 
the system, respectively. We assume that /, g, and u are such that for each initial 
condition a;(0) = xq, (2.4.34) has only one solution defined for all t G [0, cxd). If a; and 
u are measured, (2.4.34) can be expressed in the form of parametric model (2.4.33) 
by filtering each side of (2.4.34) with a stable strictly proper transfer function Wf{s), 
i.e., 

z = Wf{s)9*'^(j) (2.4.35) 
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where z = sWf{s)x, 9* = [ao,bo,co]^ , and (p = [f{x,t),g{x,t),u]^. Instead of 
(2.4.35), we may also write (2.4.34) in the form 



■Ay (Jjiyy-}^ I LLiyy-ytXj 



for some Um > 0, or 



Then 



1 



S + ttj 



-[a,nX + O*'^ (, 



A a„ 
z = X X 



1 



J I t-Lyy-y-i O I ^Tl 



*^0 



(2.4.36) 



which is in the form of (2.4.35) with Wf{s) = ^}^ . We may continue and rewrite 
(2.4.35) (respectively (2.4.36)) as 



z = 9*^^f, cf>f = Wf{s)ct> 



which is in the form of (2.4. 



(2.4.37) 
V 



The nonlinear example demonstrates the fact that the parameter 9* ap- 
pears linearly in (2.4.35) and (2.4.37) does not mean that the dynamics are 
linear. 



2.5 Problems 

2.1 Verify that x{t) and y{t) given by (2.2.4) satisfy the differential equation (2.2.2). 

2.2 Check the controllability and observability of the following systems: 

(a) 



(b) 



-0.2 
-1 0.8 

-l,l]x 



-1 


1 













-1 





x + 


1 








-2 




1 



[1,1, l]x 
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(c) 



-5 1 
-6 



y 



[iA]x 



2.3 Show that {A, B) is controllable if and only if the augmented matrix [si — A, B] 

is of full rank for all s G C. 

2.4 The following state equation describes approximately the motion of a hot air 

balloon: 



Xi 




- ]_ 

Ti 


" 




Xi 




" 1 


X2 


= 


a 


-k 




X2 


+ 





±3 . 







1 _ 

y=\ 





. ^3 . 

l]x 













w 



where xi: the temperature change of air in the balloon away from the equilib- 
rium temperature; X2: vertical velocity of the balloon; x^: change in altitude 
from equilibrium altitude; u: control input that is proportional to the change 
in heat added to air in the balloon; w: vertical wind speed; and ct, ri,T2 are 
parameters determined by the design of the balloon. 




X, (temperature) 
u(hot air) 



w (wind) 



(a) Let w = 0. Is the system completely controllable? Is it completely 

observable? 

(b) If it is completely controllable, transform the state-space representation 

into the controller canonical form. 

(c) If it is completely observable, transform the state-space representation 

into the observer canonical form. 
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(d) Assume w = constant. Can the augmented state Xa = [a;^,w]^ be 

observed from y? 

(e) Assume u = 0. Can the states be controlled by w7 

2.5 Derive the following transfer functions for the system described in Problem 2.4: 

(a) Gi{s) = -Tjj^ when w = and y = x^. 

(b) 6*2(5) = -pT^ when u = and y = X3. 

(c) Gsis) = '^^ when w = and j/i = Xi. 

(d) G^is) = ^1^ when u = and yi = x-y. 

2.6 Let a(s) = (s + a)^, 6(s) = /3, where a, /3 are constants with /3 7^ 0. 

(a) Write the Sylvester matrix of ai^s) and 6(s). 

(b) Suppose Pol's); ^o(s) is a solution of the polynomial equation 

a(s)/(s) + 6(s)p(s) = 1 (2.5.1) 

Show that (pi(s), Zi(s)) is a solution of (2.5.1) if and only if pi(s), Zi(s) 
can be expressed as 

Pi(s) =Po(s) + r(s)a(s) 
Zi(s) = Zo(s)-r(s)6(s) 

for any polynomial r(s). 

(c) Find the solution of (2.5.1) for which p(.s) has the lowest degree and 

p{s)/l{s) is a proper rational function. 

2.7 Consider the third order plant 

y = G{s)u 
where 

^, X 62S2 + 61S + 60 

G{s) 



s^ + a2S^ + ais + ao 



(a) Write the parametric model of the plant in the form of (2.4.8) or (2.4.13) 

when 9* = [62, &i, 60, 02, ai, ao]^- 

(b) If ao,ai, and 02 are known, i.e., ao = 2,ai = 1, and 02 = 3, write a 

parametric model for the plant in terms of 9* = [62, &i, &o]^- 

(c) If bo^bi, and 62 are known, i.e., 60 = 1, 61 = 62 = 0, develop a parametric 

model in terms of 0* = [a2,ai,ao]^ . 
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2.8 Consider the spring-mass-dashpot system shown below: 



u 

i 



> 



M 



n f n 



where k is the spring constant, / the viscous- friction or damping coefficient, 
m the mass of the system, u the forcing input, and x the displacement of 
the mass M. If we assume a "linear" spring, i.e., the force acting on the 
spring is proportional to the displacement, and a friction force proportional 
to velocity, i.e., x, we obtain, using Newton's law, the differential equation 

Mx = u — kx — fx 

that describes the dynamic system. 

(a) Give a state- space representation of the system. 

(b) Calculate the transfer function that relates x with u. 

(c) Obtain a linear parametric model of the form 

where 0* = [M, k, f]^ and z, (p are signals that can be generated from 
the measurements of u,x without the use of differentiators. 

2.9 Verify that (2.4.11) and (2.4.12) are nonminimal state-space representations 
of the system described by (2.4.1). Show that for the same input u{t), the 
output response y{t) is exactly the same for both systems. (Hint: Verify that 
C^[adj{sl - aS]Bo = C'^ladjisl - A)] for some Co G n",Bo G 7e"^" by 
using the identity 



[adj(s/-A)] 



s"-i/- 






s- "(A- 



a„_iJ) + s" 

-1 n — 2 I 



H h {A''"'- + a„-iA 

and choosing Cq such that (Co, Ac) is an observable pair.) 
2.10 Write a state-space representation for the following systems: 



{A^ + a„_iA + a„_2/) 
■fail) 
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(a) (p = " \~f^) u, A(s) is monic of order n. 

(b) <f) = "a'^s*)" ' ■'^i(*) ^^ monic of order n — 1. 

(c) (j> = xT^"' TO < n — 1, Ai(s) is monic of order n — 1. 
2.11 Show that 



where {Ac, I) is in the controller form and (Co,Ao) is in the observer form. 
2.12 Show that there exists constant matrices Qi G 7^("^i)^("~i) such that 

(s/-Ao) di = Qi , i=l,2,...,n 

A(s) 



-A 



where di = -A; A(s) = s"^^ + A^q;„_2(s) =det(s/ - Aq), Aq ^ 



di = [0, . . . , 0, 1, 0, . . . , 0]^ G TZ"~^ whose {i — l)th element is equal to 1, and 
f = 2, 3, . . . ,n. 



In-Q 



Chapter 3 

Stability 



3.1 Introduction 

The concept of stability is concerned with the investigation and characteri- 
zation of the behavior of dynamic systems. 

Stabihty plays a crucial role in system theory and control engineer- 
ing, and has been investigated extensively in the past century. Some of 
the most fundamental concepts of stability were introduced by the Rus- 
sian mathematician and engineer Alexandr Lyapunov in [133]. The work of 
Lyapunov was extended and brought to the attention of the larger control 
engineering and applied mathematics community by LaSalle and Lefschetz 
[124, 125, 126], Krasovskii [107], Hahn [78], Massera [139], Malkin [134], 
Kalman and Bertram [97], and many others. 

In control systems, we are concerned with changing the properties of dy- 
namic systems so that they can exhibit acceptable behavior when perturbed 
from their operating point by external forces. The purpose of this chapter is 
to present some basic definitions and results on stability that are useful for 
the design and analysis of control systems. Most of the results presented are 
general and can be found in standard textbooks. Others are more specific 
and are developed for adaptive systems. The proofs for most of the general 
results are omitted, and appropriate references are provided. Those that are 
very relevant to the understanding of the material presented in later chapters 
are given in detail. 

In Section 3.2, we present the definitions and properties of various norms 

66 



3.2. PRELIMINARIES 67 

and functions that are used in the remainder of the book. The concept of I/O 
stabihty and some standard results from functional analysis are presented 
in Section 3.3. These include useful results on the I/O properties of linear 
systems, the small gain theorem that is widely used in robust control design 
and analysis, and the £2<5-iiorm and Bellman- Gronwall (B-G) Lemma that 
are important tools in the analysis of adaptive systems. The definitions of 
Lyapunov stability and related theorems for linear and nonlinear systems are 
presented in Section 3.4. The concept of passivity, in particular of positive 
real and strictly positive real transfer functions, and its relation to Lyapunov 
stability play an important role in the design of stable adaptive systems. 
Section 3.5 contains some basic results on positive real functions, and their 
connections to Lyapunov functions and stability that are relevant to adaptive 
systems. 

In Section 3.6, the focus is on some elementary results and principles that 
are used in the design and analysis of LTI feedback systems. We concentrate 
on the notion of internal stability that we use to motivate the correct way of 
computing the characteristic equation of a feedback system and determining 
its stability properties. The use of sensitivity and complementary sensitiv- 
ity functions and some fundamental trade-offs in LTI feedback systems are 
briefly mentioned to refresh the memory of the reader. The internal model 
principle and its use to reject the effects of external disturbances in feedback 
systems is presented. 

A reader who is somewhat familiar with Lyapunov stability and the basic 
properties of norms may skip this chapter. He or she may use it as reference 
and come back to it whenever necessary. For the reader who is unfamiliar 
with Lyapunov stability and I/O properties of linear systems, the chapter 
offers a complete tutorial coverage of all the notions and results that are 
relevant to the understanding of the rest of the book. 

3.2 Preliminaries 

3.2.1 Norms and Cp Spaces 

For many of the arguments for scalar equations to be extended and remain 
valid for vector equations, we need an analog for vectors of the absolute value 
of a scalar. This is provided by the norm of a vector. 
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Definition 3.2.1 The norm |a:| of a vector x is a real valued function with 
the following properties: 

(i) \x\ > with \x\ = if and only if x = 

(ii) \ax\ = \a\\x\ for any scalar a 

(iii) |a; + y| < |x| + \y\ (triangle inequality) 

The norm \x\ of a vector x can be thought of as the size or length of the 
vector X. Similarly, |x — y| can be thought of as the distance between the 
vectors x and y. 

An m X n matrix A represents a linear mapping from n-dimensional 
space 7?-" into m-dimensional space "R.™. We define the induced norm of A 
as follows: 

Definition 3.2.2 Let \ ■ \ be a given vector norm. Then for each matrix 
A e TZ"'-^"-, the quantity \\A\\ defined by 

II 411 A \Ax\ I . I I . I 

ll^ll = sup - — - = sup \Ax\ = sup \Ax\ 
^/o \x\ \x\<l \x\=l 

is called the induced (matrix) norm of A corresponding to the vector 

norm | • |. 

The induced matrix norm satisfies the properties (i) to (iii) of Definition 
3.2.1. 

Some of the properties of the induced norm that we will often use in this 
book are summarized as follows: 

(i) |^x| < ||A|||x|, VxeTe" 
(ii) ||A + S|| < \\A\\ + \\B\\ 
(iii) ||A5|| < ||A||||S|| 

where A, B are arbitrary matrices of compatible dimensions. Table 3.1 shows 
some of the most commonly used norms on 7?,". 

It should be noted that the function ||^||s = maxjj |ajj|, where A e 
■j^mxn ^jr^^ g_ jg |-]^g (i, j) element of A satisfies the properties (i) to (iii) 
of Definition 3.2.1. It is not, however, an induced matrix norm because no 
vector norm exists such that || • \\s is the corresponding induced norm. Note 
that II • \\s does not satisfy property (c). 
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Table 3.1 Commonly used norms 


Norm on 7^" 


Induced norm on 7^"^^" 


X oo=inaxj Xi (infinity norm) 


\\A\\oo = niaxjX^j \aij\ (row sum) 


\x\i = J2i \Xi\ 


\\A\\i = maxj J2i \0'ij\ (column sum) 


N2 = (EJX.|2)V2 


Uh = [XmiA^A)]^^ where A„,(M) 


(Euclidean norm) 


is the maximum eigenvalue of M 



Example 3.2.1 (i) Let x = [1,2,-10,0]^. Using Table 3.1, we have 

|a;|oo = 10, |x|i = 13, |x|2 = Vl05 

(ii) Let 

" 5 

1 

^ -10 

Using Table 3.1, we have 

||A||i = 15, p||2 = 11.18, p|U = 10 
||B||i = 7, ||B||2 = 5.465, ||S|U = 6 

||AB||i = 35, \\AB\\2 = 22.91, \\AB\U. = 20 

which can be used to verify property (iii) of the induced norm. 



, B = 


■-15" 
2 







V 



For functions of time, we define the £„ norm 



A 



|x(r)|P(iT 



i/p 



for p e [l,oo) and say that x ^ Cp when ||x||p exists (i.e., when ||x||j, is 
finite). The Coo norm is defined as 



A 



sup \x(t)\ 
t>0 



and we say that x G Coo when ||a;||oo exists. 

In the above Cp, Coo norm definitions, x(t) can be a scalar or a vector 
function. If x is a scalar function, then | ■ | denotes the absolute value. If x 
is a vector function in 7?." then | • | denotes any norm in 7Z^. 
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Similarly, for sequences we define the Ip norm as 

Ikllp = I ^|xj|^| , 1 < p < oo 

and the l^o norm as 

II II — II 

ll'^llcxD — sup \Xi\ 
i>l 

where x = (xi,X2, • • •) and Xj e TZ. We say x ^ Ip (respectively x £ ^oo) if 
||a;||p (respectively ||x||oo) exists. 

We are usually concerned with classes of functions of time that do not 
belong to Cp. To handle such functions we define the Cpe norm 



\xt\\p=Q'\x{T)\PdTy 



for p e [1,00) and say that x £ Cpe when ||xt||p exists for any finite t. 
Similarly, the £ooe norm is defined as 

II II ^ I / M 

||a;t||oo = sup \x[T)\ 

0<T<t 

The function i^ does not belong to Cp but t^ £ Cpe- Similarly, any continuous 
function of time belongs to Cpe but it may not belong to Cp. 

For each p £ [1, 00], the set of functions that belong to Cp (respectively 
Cpe) form a linear vector space called Cp space (respectively Cpe space) [42]. 
If we define the truncated function ft as 

A|/(r) 0<r<t 

■'^^ ' \ T>t 

for all t e [0,00), then it is clear that for any p G [l,c5o], / G Cpe implies 
that ft e Cp for any finite t. The Cpe space is called the extended Cp space 
and is defined as the set of all functions / such that ft £ Cp. 

It can be easily verified that the Cp and Cpe norms satisfy the properties 
of the norm given by Definition 3.2.1. It should be understood, however, 
that elements of Cp and Cpe are equivalent classes [42], i.e., if f,g ^ Cp and 
11/ ~ 9\\p = Oj the functions / and g are considered to be the same element 
of Cp even though /(t) 7^ g{t) for some values of t. The following lemmas 
give some of the properties of Cp and Cpe spaces that we use later. 
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f e Cp, g ^ Cq imply that fg £ £i and 



Lemma 3.2.1 (Holder's Inequality) Ifp,q £ [l,oo] and - + - = 1, then 



Wfah < 11/11 



p\\y\\q 



When p = q = 2, the Holder's inequahty becomes the Schwartz inequal- 
ity, i.e., 

Il/fflli < ll/lblbib (3.2.1) 

Lemma 3.2.2 (Minkowski Inequality) For p £ [l,oo], f,g G Cp imply 
that f + g ^ Cp and 

||/ + fl||p<||/||p + ||ff||p (3.2.2) 

The proofs of Lemma 3.2.1 and 3.2.2 can be found in any standard book on 
real analysis such as [199, 200]. 

We should note that the above lemmas also hold for the truncated func- 
tions ft,gt of f,g, respectively, provided f,g ^ Cpe- For example, if / and 
g are continuous functions, then f,g ^ Cpe, i.e., ft,gt G Cp for any finite 
t e [0,oo) and from (3.2.1) we have \\{fg)t\\i < 11/4112115*112, i-e., 

^ \fir)gir)\dT < ^J^ \fir)\^dT^ ' ^J^ \9ir)\'dr^ ' (3.2.3) 

which holds for any finite t > 0. We use the above Schwartz inequality 
extensively throughout this book. 

Example 3.2.2 Consider the function f{t) = j^-r. Then, 



loo = sup 



1 + t 



rdt 



{i + ty 

dt = lini ln(l + t) —> oo 



l + t t^oo 

Hence, / G 'C2n'^oo but / Ci; /, however, belongs to >Cie, i.e., for any finite 

t > 0, we have 

* 1 

dr = ln(l + t) < oo V 

1 + T 
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Example 3.2.3 Consider the functions 

f{t) = l + t, 5(i) = ^, fort>0 

It is clear that f ^ Cp for any p G [l,oo] and g ^ Ci. Both functions, however, 
belong to Cpe] and can be used to verify the Schwartz inequality (3.2.3) 

||(/5)*||l<||/t||2||9*l|2 



ldT<([{l + rfdr] ( [ -— L— dr 



for any t G [0, oo) or equivalently 



(1 + t) = 



,'i(i2 + 3f+3) 



,1 + ^. 
which is true for any t > 0. \7 

In the remaining chapters of the book, we adopt the following notation 
regarding norms unless stated otherwise. We will drop the subscript 2 from 
I ■ b) II • lb when dealing with the Euclidean norm, the induced Euclidean 
norm, and the £2 norm. If x : TZ'^ 1-^ TZ^\ then 

|x(t)| represents the vector norm in TZ'"" at each time t \\xt\\p repre- 
sents the Cpe norm of the function |x(t)| ||x||p represents the Cp norm of 
the function |x(t)| 
If A e 7^™^", then 
ll^lli represents the induced matrix norm corresponding to the vector 

norm | • |j. 
If A : TZ'^ 1-^ -j^mxri j^g^g elements that are functions of time t, then 

||A(t)||j represents the induced matrix norm corresponding to the vector 
norm | ■ |j at time t. 

3.2.2 Properties of Functions 

Let us start with some definitions. 

Definition 3.2.3 (Continuity) A function f : [0,oo) >-^ TZ is continuous 

on [0,c5o) if for any given eg > there exists a (5(eo,to) such that Vto,t £ 
[0,00) for which \t — to\ < (5(eo,to) we have \f{t) — /(to)| < eo- 
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Definition 3.2.4 (Uniform Continuity) A function f : [0,c5o) >-^ TZ is 

uniformly continuous on [0, oo) if for any given eo > there exists a 5(eo) 
such that yto,t e [0, cx)) for which |t — to| < ^i^o) we have \f(t) — /(to)| < ^o- 

Definition 3.2.5 (Piecewise Continuity) A function f : [0,oo) >-^ TZ is 

piecewise continuous on [0, oo) if f is continuous on any finite interval 
[to^^i] C [0,oo) except for a finite number of points. 

Definition 3.2.6 (Absolute Continuity) A function f : [a,b] t-^ TZ is 
absolutely continuous on [a, b] iff, for any eo > 0, there is a S > such that 

n 

El/(«0-/(/3^)l<^o 

4 = 1 

for any finite collection of subintervals {ai,Pi) of[a,b] withJ27=i \'^i~Pi\ < '^• 

Definition 3.2.7 (Lipschitz) A function f : [a,b] -^ TZ is Lipschitz on 

[a, b] if |/(a:i) — f(x2)\ < k\xi — X2\ Vxi, X2 £ [a, b], where k > is a constant 
referred to as the Lipschitz constant. 

The function /(t) = sin(-^) is continuous on (0, oo), but is not uniformly 
continuous (verify!). 

A function defined by a square wave of finite frequency is not continuous 
on [0,oo), but it is piecewise continuous. 

Note that a uniformly continuous function is also continuous. A function 
/ with / G Coo is uniformly continuous on [0,oo). Therefore, an easy way 
of checking the uniform continuity of f(t) is to check the boundedness of /. 
If / is Lipschitz on [a, b], then it is absolutely continuous. 

The following facts about functions are important in understanding some 
of the stability arguments which are often made in the analysis of adaptive 
systems. 

Fact 1 limt^oo fit) = does not imply that /(t) has a limit as t ^ oo. 

For example, consider the function /(t) = sin(Vl + t). We have 

• cos VI + t 

f = , > as t ^ oo 

2^1 + t 
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but /(t) has no limit. Another example is /(t) = Vl + tsin(ln(l + t)), which 
is an unbounded function of time. Yet 

. sin(ln(l + t)) , cos(ln(l + t)) 

fit) = , , > as i ^ oo 

Fact 2 linii^oo /(i) = c for some constant c ^ TZ does not imply that f(t) -^ 
as t —I- oo. 

For example, the function /(t) = '^'"^^^ , ^ ' tends to zero as t ^ oo for any 
finite integer n but 

/ = -^^^^+n(i+tr-2cos(i+tr 

has no limit for n > 2 and becomes unbounded as t ^ oo for n > 2. 

Some important lemmas that we frequently use in the analysis of adaptive 
schemes are the following: 

Lemma 3.2.3 The following is true for scalar- valued functions: 

(i) A function f{t) that is hounded from below and is nonincreasing has a 

limit as t ^ oo. 
(ii) Consider the nonnegative scalar functions f(t),g(t) defined for all t> 

0. // fit) < g{t) yt>0 and ge Cp, then f e Cp for all p e [1, oo]. 

Proof (i) Because / is bounded from below, its infinium /„ exists, i.e., 

fm = inf f{t) 

0<t<oo 

which implies that there exists a sequence {tn} G TZ^ such that lim„^oo /(^n) = fm- 
This, in turn, implies that given any Eq > there exists an integer TV > such that 

\f{t„) - fm\ < eo, Vn > TV 

Because / is nonincreasing, there exists an no > A^ such that for any t > tn„ and 
some no > N we have 

fit) < /(t„„) 
and 

\f{t)-fm\<\f{tno)-fm\<eo 

for any t > t^^^. Because 69 > is any given number, it follows that lini^^oo /(O — 

Jm- 
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(ii) We have 

z{t) = (J F{r)dT] ' < (J°° gP{T)dr] ' < oo, Vt > 

Because < z{t) < c» and z{t) is nondecreasing, we can establish, as in (i), that 
z{t) has a hniit, i.e., linij^oo z{t) = z < c», which implies that / G Cp. For p = c», 
the proof is straightforward. D 

Lemma 3.2.3 (i) does not imply that / G £oo- For example, the function 
f{t) = J with t e (0,oo) is bounded from below, i.e., f{t) > and is 
nonincreasing, but it becomes unbounded as t ^ 0. If, however, /(O) is 
finite, then it follows from the nonincreasing property /(t) < /(O) Vt > 
that / e Coo- A special case of Lemma 3.2.3 that we often use in this book 
is when / > and / < 0. 

Lemma 3.2.4 Let f, V : [0,oo) h^ TZ. Then 

V < -aV + f, Vt > to > 
implies that 

V(t) < e-"(*-*°V(to) + f e-''^^-^^f(T)dT, Vt > to > 

for any finite constant a. 

Proof Let w{t) = V + aV - f. We have w{t) < and 

V = -aV + f + w 
implies that 

Jt„ Jto 

Because w{t) < \/t > to > 0, we have 

V{t) < £-"(*-*" V(to) + / e-°''^'-^^f{T)dT 

n 
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Lemma 3.2.5 If f, f ^ Coo and f ^ Cp for some p e [1, oo), then f(t) —i- 
as t ^ oo. 

The result of Lemma 3.2.5 is a special case of a more general result given 
by Barbalat's Lemma stated below. 

Lemma 3.2.6 (Barbalat's Lemma [192]) // limt^oo Jq fiT~)dT exists 
and is finite, and f{t) is a uniformly continuous function, i/ien limj^oo f{t) = 
0. 



Proof Assume that linii^oo f{t) = does not hold, i.e., either the limit does not 
exist or it is not equal to zero. This implies that there exists an eo > such that 
for every T > 0, one can find a sequence of numbers ti > T such that |/(ii)| > Cq 
for all i. 

Because / is uniformly continuous, there exists a number (5(eo) > such that 

\f{t) - f{ti)\ < I for every t e [U,t, + ,5(eo)] 

Hence, for every t G [ti,ti-\- (5(eo)], we have 



\f{t)\ 



which implies that 



> eo 



\f[t)-f{t,) + f{t,)\>\f{t,)\-\f{t)-f{U)\ 
eo _ eo 
2 ~ 2 



U+S(<La) 



f{r)dT 



|/(r)|rfr>^ 



(3.2.4) 



where the first equality holds because /(t) retains the same sign for t G [ti, ii+(5(eo)]. 

On the other hand, g{t) = L f(T)dT has a limit as i — > c» implies that there exists 
a T(eo) > such that for any t2> ti> T{eo) we have 



\giti) - g{t2)\ < 



I.e., 



f{T)dT 



< 



eo<5(eo) 
2 



which for ^2 = ti + 6{eQ), ti = ti contradicts (3.2.4), and, therefore, linit^oo f{t) = 0. 



D 
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The proof of Lemma 3.2.5 follows directly from that of Lemma 3.2.6 by 
noting that the function /^(t) is uniformly continuous for any p e [l,oo) 
because f,f^ Coo- 

The condition that /(t) is uniformly continuous is crucial for the results 
of Lemma 3.2.6 to hold as demonstrated by the following example. 

Example 3.2.4 Consider the following function described by a sequence of isosceles 
triangles of base length -^ and height equal to 1 centered at n where n = 1, 2, ... (X) 
as shown in the figure below: 

fit) 




n 



1 1 

4 



This function is continuous but not uniformly continuous. It satisfies 

,2 



•Jo ^ ' 2^^n2 12 



but linit^oo f{t) does not exist. \J 

The above example also serves as a counter example to the following situ- 
ation that arises in the analysis of adaptive systems: We have a function V{t) 
with the following properties: V{t) > 0, F < 0. As shown by Lemma 3.2.3 
these properties imply that limt^oo V{t) = Vqo exists. However, there is no 
guarantee that V{t) ^ as t ^ cx). For example consider the function 

V{t) = 7r- f f(j)dT 
Jo 

where /(t) is as defined in Example 3.2.4. Clearly, 

V{t) > 0, V = -f{t) < 0, Vt > 

and 

lim V{t) = y^ = vr - ^ 



78 CHAPTERS. STABILITY 

but linif^oo ^(i) = — liiiit^cx) /(i) does not exist. According to Barbalat's 
lemma, a sufficient condition for V(t) ^ as i ^ oo is that V is uniformly 
continuous. 

3.2.3 Positive Definite Matrices 

A square matrix A £ -/^"x™ jg called symmetric if ^ = A~^ . A symmet- 
ric matrix A is called positive sem,idefinite if for every x G 7Z^\ x'^ Ax > 
and positive definite if x'^ Ax > Vx e 7?," with |x| / 0. It is called neg- 
ative semidefinite (negative definite) if —A is positive semi definite (positive 
definite) . 

The definition of a positive definite matrix can be generalized to non- 
symmetric matrices. In this book we will always assume that the matrix 
is symmetric when we consider positive or negative definite or semidefinite 
properties. 

We write ^ > if A is positive semidefinite, and ^ > if ^ is positive 
definite. We write A > B and A > B if A - B > and A - B > 0, 
respectively. 

A symmetric matrix A e 7^"X" jg positive definite if and only if any one 
of the following conditions holds: 

(i) Xi(A) > 0, i = 1,2, ... ,n where Xi{A) denotes the ith eigenvalue of A, 

which is real because A = A . 
(ii) There exists a nonsingular matrix Ai such that A = AiAj . 

(iii) Every principal minor of A is positive. 

(iv) x~^ Ax > a|xp for some a > and Vx G 7Z"'. 

The decomposition A = AiAj in (ii) is unique when Ai is also symmetric. 

In this case, Ai is positive definite, it has the same eigenvectors as A, and 
its eigenvalues are equal to the square roots of the corresponding eigenvalues 
of A. We specify this unique decomposition of A by denoting Ai as A^ , i.e., 
A = A^A^ where ^2 ig a positive definite matrix and A~^''^ denotes the 
transpose of A^'"^. 

A symmetric matrix A G -/^"X" ]^Qg ^ orthogonal eigenvectors and can 
be decomposed as 

A = U^AU (3.2.5) 

where L'^ is a unitary (orthogonal) matrix (i.e., U^U = I) with the eigen- 



3.3. INPUT/OUTPUT STABILITY 79 

vectors of A, and A is a diagonal matrix composed of the eigenvalues of A. 
Using (3.2.5), it follows that if A > 0, then for any vector x e TZ"' 

■^min\Aj\x\ < X Ax < Amaxv^j l-^l 

Furthermore, if ^ > then 

and if ^ > we also have 

\\A-'h = ^— 

where Xmaxi-^) ^ ^min{A) IS the maximum and minimum eigenvalue of A, 
respectively. 

We should note that if A > and i? > 0, then A + B > Q, but it is not 
true in general that AB > 0. 

3.3 Input/Output Stability 

The systems encountered in this book can be described by an I/O mapping 
that assigns to each input a corresponding output, or by a state variable 
representation. In this section we shall present some basic results concerning 
I/O stability. These results are based on techniques from functional analysis 
[42], and most of them can be applied to both continuous- and discrete- 
time systems. Similar results are developed in Section 3.4 by using the state 
variable approach and Lyapunov theory. 

3.3.1 Cp Stability 

We consider an LTI system described by the convolution of two functions 
u, h : TZ'^ -^ TZ defined as 

^ rt rt 



y{t) = u*h= h{t - T)u{T)dT = u{t-T)h{T)dT (3.3.1) 

Jo Jo 

where u, y is the input and output of the system, respectively. Let H(s) be 
the Laplace transform of the I/O operator /i(-). H(s) is called the transfer 
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function and h(t) the impulse response of the system (3.3.1). The system 
(3.3.1) may also be represented in the form 

Y{s) = H{s)U{s) (3.3.2) 

where Y(s), U(s) is the Laplace transform of y, u respectively. 

We say that the system represented by (3.3.1) or (3.3.2) is Cp stable if 
u ^ Cp =f- y ^ Cp and ||y||p < c||u||p for some constant c > and any 
u e Cp. When p = oo, Cp stability, i.e., £oo stability, is also referred to as 
bounded-input bounded-output (BIBO) stability. 

The following results hold for the system (3.3.1). 

Theorem 3.3.1 If u ^ Cp and h ^ Ci then 

\\y\\p < \\h\\i\\u\\p (3.3.3) 

where p ^ [1, oo]. 

When p = 2 we have a sharper bound for ||y||p than that of (3.3.3) given by 
the following Lemma. 

Lemma 3.3.1 If u €z C2 and h ^ Ci, then 

||y||2<sup|i/(ia;)|||n||2 (3.3.4) 

For the proofs of Theorem 3.3.1, Lemma 3.3.1 see [42]. 

Remark 3.3.1 It can be shown that (3.3.4) also holds [232] when /i(-) is of 
the form 

,(,. ^ f i < 

^' \ j:r=omt-ti) + fa{t) t>o 

where fa £ Ci,J2^o I/* I < °° ^^'^ ^« ^^^ nonnegative finite constants. 
The Laplace transform of h(t) is now given by 

00 
H{s) = Y^f\e-''^+Ha{s) 

which is not a rational function of s. The biproper transfer functions 
that are of interest in this book belong to the above class. 
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Remark 3.3.2 We should also note that (3.3.3) and (3.3.4) hold for the 
truncated functions of u,y, i.e., 

WutWp < l|/i||i||«t||p 

for any t G [0, oo) provided u £ Cpg. Similarly, 

Wvth < sup|i:/"(ja;)|||nt||2 

for any t £ [0, oo) provided u G £2e- This is clearly seen by noticing 
that u e Cpe =^ Ut E Cp for any finite t > 0. 

It can be shown [42] that inequality (3.3.3) is sharp for p = oo because 
\\h\\i is the induced norm of the map T : u h-i- Tu = y from £oo into £00, i-e., 
Il^lloo = ll^lli- Similarly for (3.3.4) it can be shown that the induced norm 
of the linear map T : £2 ^^ -^2 is given by 

IITII2 = sup |i7(jLj)| (3.3.5) 

i.e., the bound (3.3.4) is also sharp. 

The induced £2 norm in (3.3.5) is referred to as the Hao norm for the 
transfer function H{s) and is denoted by 

\\H{s)\\oo = ^nY>\H{joj)\ 

Let us consider the simple case where h{t) in (3.3.1) is the impulse response 
of an LTI system whose transfer function H{s) is a rational function of s. 
The following theorem and corollaries hold. 

Theorem 3.3.2 Let H{s) he a strictly proper rational function of s. Then 
H{s) is analytic in Re[,s] > if and only if h E Ci. 

Corollary 3.3.1 If h e £1, then 

(i) h decays exponentially , i.e., \h{t)\ < aie~°°* for some ai,ao > 
(ii) It e £1 ^ y e Ci{~\Coo.,y ^ Ci, y is continuous and limt^oo \y{t)\ = 
(iii) tt e £2 ^ y e 'C-2r\^oo,y £ ^2, y is continuous and limt^oo |y(OI = 
(iv) For p e [l,oo],u ^ Cp ^ y,y ^ Cp and y is continuous 
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For proofs of Theorem 3.3.2 and Corollary 3.3.1, see [42]. 

Corollary 3.3.2 Let H(s) be biproper and analytic in Re[s] > 0. Then u G 
^2r\^oc, and limt^oc, \u{t)\ = imply that y e £20-^00 and limt^oc, \y{t)\ = 
0. 

Proof H{s) may be expressed as 

H{s) = d+Ha{s) 

where rf is a constant and Ha{s) is strictly proper and analytic in Re[s] > 0. We 
have 

y = du + ya, ya = Ha{s)u 

where, by Corollary 3.3.1, ya G >C2 H '^oo and |j/a(OI ^ as i — > 00. Because 
u e C2{~\Jl-oo and u{t) ^ as i ^ (X), it follows that y G Jl-2{~\^oo and \y{t)\ -^ 
as i — > cxD. D 

Example 3.3.1 Consider the system described by 

y = H{s)u, H{s) 



s + (i 



for some constant a > 0. For /3 > 0, H{s) is analytic in Re\s\ > 0. The impulse 
response of the system is given by 



h{t) 



t<a 



and /i G £1 if and only if /3 > 0. We have 



\h{t)\dt= / e-'^(*-")(it = - 



/? 



and 



\H{s) 



sup 



-QJli; 



3UJ + I3 



1 



V 



Example 3.3.2 Consider the system described by 

2s + 1 



y = H{s)u, H{s) 



s + 5 
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The impulse response of the system is given by 
h{t)-- 



2SA{t) - 9e"5* t > 
i < 



where ha = — 9e ^* G Ci. This system belongs to the class described in Re- 
mark 3.3.1. We have 



\H{s) 



sup 



1 + 2juj 



5 + juj 



sup 



25 + cj2 



Hence, according to (3.3.4) and Remarks 3.3.1 and 3.3.2, for any u G C2e, we have 

hth < 2\\uth 
for any t G [0, oo). V 



Definition 3.3.1 (/i— small in the mean square sense (m.s.s.)) Let 

X : [0, cx)) 1-^ TZ^, where x e C2e, and consider the set 



5(/i) = <x:[0,oo)^n'^' 



f x^(r)x(T)dr < co^T + ci, Vt, T > > 



for a given constant ^ > 0, where co,ci > are some finite constants, and 
Co is independent of ^. We say that x is ^— small in the m.s.s. if x ^ 'SifJ-). 

Using the proceeding definition, we can obtain a result similar to that of 
Corollary 3.3.1 (iii) in the case where n ^ £2 but u G 5(;u) for some constant 
/i>0. 

Corollary 3.3.3 Consider the system (3.3.1). If h e Ci, then u e 5(^) 
implies that y £ S{ii) and y e £00 for any finite fi > 0. Furthermore 



tti 



|yWP < ^ 



sQo 



-(co/i + ci), Vt>to>0 



ao {1 — e 

where ao,ai are the parameters in the bound for h in Corollary 3.3.1 (i). 
Proof Using Corollary 3.3.1 (i), we have 



\y{t)\< / \h{t - T)u{T)\dT < / aie-""(*^^)|u(T)|rfr, Vt > to > 
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for some constants ai,ao > 0. Using the Schwartz inequahty we obtain 

Jto Jta 



< ill / e-""(*-^)|M(r)|2dT (3.3.6) 

"0 Jto 



Therefore, for any t > ^o ^ s-nd T > we have 



at 



"0 Ji Jto 

(3.3.7) 
Using the identity involving the change of the sequence of integration, i.e., 

t+T i-T r-t + T j-t+T 

f{T) / g{s)dsdT = / g{s) / f{T)dTds (3.3.8) 

't Jt Jt Js 

for the second term on the right-hand side of (3.3.7), we have 

t+T 2 ft+T i-t 

\y{T)\^dT < -^ / e-""^dT / e"'"'|M(s)|2rfs 

t "0 Jt Jto 

2 ft+T / ft+T \ 

+ ^ / e"'"'|w(s)|2 / e-^o^dr ds 
< 4 ( / e-""(*-^V(s)|2ds+ / \u{s)\''ds 



2 

V-'to 



where the last inequality is obtained by using e ""* — e "t)(*+^) < e ""*. Because 
u G 5(/i) it follows that 

ft+T 2 

/ \y{T) fdr < ^ [A(i, to) + conT + ci] (3.3.9) 

Jt "o 

where A(i,to)) = /^ e~""(*~^)|u(s)pds. If we establish that A(i,io) < c for some 
constant c independent of t,to then we can conclude from (3.3.9) that y G S{fi). 
We start with 

A(i,to) = / e-'^"^'-'^\u{s)\^ds 
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"t ,.i+l+to 

< e-""*^/ e°""\u{s)\^ds (3.3.10) 

< e-"'>*^e""(*+i+*") / \u{s)\^ds 

.■_n J i + tn 



i = 



where n-t is an integer that depends on t and satisfies rit + to < t < nt + I + Iq. 
Because u G S{fj,), we have 



"t 



A(t, io) < e-"''*(co/i + ci) X^ e""(^+i+*») < """^ ^_% "° (3.3.11) 

Using (3.3.11) in (3.3.9) we have 

for any i > io > 0. Setting cq = ^ and ci = (ci + fz^^e""') ^, it follows that 

From (3.3.6), (3.3.10), and (3.3.11), we can calculate the upper bound for |y(t)p. 

D 

Definition 3.3.1 may be generalized to tlie case wliere /x is not necessarily 
a constant as follows. 

Definition 3.3.2 Let x : [0, oo) i-^ 7?,", w : [0,oo) i-^ TZ'^ where xe£2e; 
w e Cie and consider the set 



S{w) = <.x,w 



t+T i-t+T 

x'^ {T)x{T)dT < CO w{T)dT + ci,yt,T > 

t Jt 



where co,ci > are some finite constants. We say that x is w-small in the 
m.s.s. if X E S(w). 

We employ Corollary 3.3.3, and Definitions 3.3.1 and 3.3.2 repeatedly in 
Chapters 8 and 9 for the analysis of the robustness properties of adaptive 
control systems. 

3.3.2 The £25 Norm and I/O Stability 

The definitions and results of the previous sections are very helpful in devel- 
oping I/O stability results based on a different norm that are particularly 
useful in the analysis of adaptive schemes. 
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In this section we consider the exponentially weighted £2 norm defined 

as 

1 
2 



\xt\\2S= (^j\-'^'-^^x'{T)x{T)dT^ 



where 5 > is a constant. We say that x £ C25 if ||a;t||25 exists. When 5 = 
we omit it from the subscript and use the notation x £ £2e- 

We refer to ||(-)||25 as the C2S norm. For any finite time i, the C25 norm 
satisfies the properties of the norm given by Definition 3.2.1, i.e., 

(i) Wxths > 

(ii) ||axt||25 = |a|||xi||25 for any constant scalar a 

(iii) ||(a; + y)th5 < Wxths + Wvths 

It also foliows that 

(iv) ||axf||25 < ||a;t||25supja(t)| for any a e £00 

The notion of C25 norm has been introduced mainly to simplify the sta- 
bility and robustness analysis of adaptive systems. To avoid confusion, we 
should point out that the C2S norm defined here is different from the ex- 
ponentially weighted norm used in many functionai anaiysis books that is 

defined as I Jq e x {T)x{T)dT \ ^ . The main difference is that this exponen- 
tially weighted norm is a nondecreasing function of t, whereas the C25 norm 
may not be. 

Let us consider the LTI system given by 

y = H{s)u (3.3.12) 

where H{s) is a rational function of s and examine £25 stability, i.e., given 
u e £2(5) what can we say about the Cp,C2S properties of the output y{t) 
and its upper bounds. 

Lemma 3.3.2 LetH(s) in (3.3.12) he proper. If H{s) is analytic in Re[s] > 
—5/2 for some 5 > and u e £2e then 

(i) 

WVths < \\H{s)\\oo5\\ut\\25 

where 



\H{s)\\oo5 = sup 



H[J.-'- 
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(ii) Furthermore, when H(s) is strictly proper, we have 

\y{t)\ < \\H{s)\\25\\uth5 
where 



\His) 



A 1 



25 



/27r 



H ju 



doj 



The norms \\H{s)\\2S, \\H{s)\\oo5 o,re related by the inequality 

1 



\H{s) 



25 



< 



is + p)H{s)l 



for any p > S/2 > 0. 
Proof The transfer function H{s) can be expressed as H{s) = d+ Ha{s) with 

h(t\- / ^<0 

^' \ d5^{t) + ha{t) t>0 

Because rf is a finite constant, H{s) being analytic in Re[s] > —6/2 implies that 

ha G Ci, i.e., the pair {H{s),h{t)} belongs to the class of functions considered in 

Remark 3.3.1. 

If we define 

Jo t < 

^^*^~t d6A{t) + e^'ha{t) t>0 
ysit) = e2*y(t) and us{t) = e^*u{t), it follows from (3.3.1) that 



V5{t) 



62 '* ^^h{t — T)e^^u{T)dT = hs *us 



Now u G C2e => w<5 G C2e- Therefore, applying Lemma 3.3.1 and Remark 3.3.1 for 
the truncated signals yst^ust at time t and noting that H[s — S/2) is the Laplace 
transform of kg we have 



\\yst\\2<\\H{s-S/2)\U\usth 



(3.3.13) 



Because e 2*||y5t||2 = ||yt||2<s, e 2*||M5t||2 = \\ut\\2S, and ||i7(s-(5/2)||oo = \\H{s)\\ooS, 
(i) follows directly from (3.3.13). 

For d = 0, i.e., H{s) is strictly proper, we have 



\yit)\ < 



ef (*-^)/i(t _ ^)e-t(*-^)u(r)rfT 



e'(^-^)\h{t-T)\^dr) \\ut\\ 



1 2(5 
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where the second inequahty is obtained by applying the Schwartz inequality. Then, 
\y{t)\ < (^J\'^'"^^\h{t-T)fdrJ\\u,hs 

■H{juj-S/2)\^dLj] Wuths (3.3.14) 



/2tt 



where the equality is obtained by assuming that H{s) is strictly proper and applying 
Parseval's Theorem [42] (p. 236), implies (ii). 
because H{s) is strictly proper, we can write 

1 / r°° 1 

\\His)hs = ^^ / \{JLo + po)H{ju-d/2)\ \. du 

< -Lf/ ^ du)\up{\{j^ + p,)H{ju-S/2)\) 



V2pE 
for any po > 0. Setting Pa = p — 5/2, the result follows. □ 



Remark 3.3.3 Lemma 3.3.2 can be extended to the case where H(s) is 
not rational in s but belongs to the general class of transfer functions 
described in Remark 3.3.1. 

We refer to ||i^(s)||25, ||-f/^(s)||oo(5 defined in Lemma 3.3.2 as the 5-shifted 
H2 and Hao norms, respectively. 

Lemma 3.3.3 Consider the linear time-varying system given by 

X = A{t)x + B{t)u, X(0)=X0 /QQirrN 

y = C^{t)x + D{t)u ^'^■'^■^^> 

where x £ TV^^y G TV ,u £ TZ™" , and the elements of the matrices A,B,C, 
and D are bounded continuous functions of time. If the state transition 
matrix $(t,T) of (3.3.15) satisfies 

||$(t,r)|| < Aoe-°"(*-^) (3.3.16) 

for some Aq, oq > and u e C2e, then for any 5 e [0, ^i) where < ^i < 2ao 
is arbitrary, we have 
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cAq 



(ii) \\xth5 < '-^ 



(iii) ||yt||2<5 < Co||'Ut||25 + Ci 



\ut\\25 + et 



where 



Co 



-==^£=^ sup WC^m + sup \\D{t)lc = sup \\B{t)\\ 



and tt is an exponentially decaying to zero term because xq / 0. 
Proof The solution x{t) of (3.3.15) can be expressed as 

X(t) = $(t,0)xo+ / <^{t,T)B{T)u{T)dT 

Jo 
Therefore, 

\x{t)\ < ||<l>(i,0)|||xo|+ f\mt,T)\\ \\B{t)\\ \u{T)\dT 

Jo 



Using (3.3.16) we have 



\x{t)\<et + c\o / e-""(*-^V(T)|rfT 



(3.3.17) 



where c and Aq are as defined in the statement of the lemma. Expressing e ""*•* '^' 
as e"*-""" 2-"'*~'^-'e~2 '•*~'^-' and applying the Schwartz inequality, we have 



\x{t)\ < et + cAo f / e-(2"o-5)(t-r)^^ 
V2ao-'5 



,-'5(t-r) 



u(T)prfT 



which completes the proof of (i). Using property (iii) of Definition 3.2.1 for the C25 
norm, it follows from (3.3.17) that 



\xt\\2S< ||et||25 + cAo||Ot| 



2(5 



(3.3.18) 



where 



WQths- 



A 



^-O!o(t-T) 



u{T)\dT 



25 



<5(t-T) / „-aa(T-s) 



u{s)\ds] dr 
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Using the Schwartz inequahty we have 



^0 -'0 

2ao - di Jq 



Sit-r) / ^-<5i(t-s)| 



||Q,||2, < , / e-'^'-^> / e-'^^--^>\u{srdsdr (3.3.19) 

VZao - di \Jo Jo / 

Interchanging the sequence of integration, (3.3.19) becomes 

i_ 

' ' e~''+'-'\u{s)f- ds^ 



V2ao - h \Ja 5i - S 

1 / /■* e"''^*^'') - e~'^i(*"^) 

— |u(s)pds 



< ^ ^ f re^*(*-^V(s)|'ds 

for any S < Si < 2ao. Because ||et||2<5 < ft, the proof of (ii) follows. 
The proof of (iii) follows directly by noting that 

lbt||25<||(C^a:)t||25+||(i5«)t||25<||xt||25SUp||C^(i)|| + h,||25SUp||D(i)|| 

t t 



□ 



A useful extension of Lemma 3.3.3, applicable to the case where A{t) is 
not necessarily stable and (5 = (5o > is a given fixed constant, is given by 
the following Lemma that makes use of the following definition. 

Definition 3.3.3 The pair {C{t),A{t)) in (3.3.15) is uniformly completely 

observable (UCO) if there exist constants (3i,(32i'^ > such that for all 
to>0, 

p2l>Nito,to + u)>(3iI 
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where N(to,to + i^) = //^''+'' $^(t, to)C(T)C^(r)$(r, to)t?T is the so-called 
observability grammian [1, 201] and $(t, r) is the state transition matrix 
associated with A{t). 

Lemma 3.3.4 Consider a linear time-varying system of the same form as 
(3.3.15) where {C{t),A{t)) is UCO, and the elements ofA,B,C, and D are 
bounded continuous functions of time. For any given finite constant Sq > 0, 
we have 

(^) 1^(^)1 - 71^=7;^ (^1 1 1^*1 1 2-50 + C2||yt||25o) + et 

(iii) l|yt||25o < l|2;t||25oSUPf ||C^(t)|| + ||ut||25oSUPt ||-D(t)|| 

where ci,C2 > are some finite constants; 5i,ai satisfy 60 < 5i < 2a\, and 
tt is an exponentially decaying to zero term because xq / 0. 

Proof Because (C, A) is uniformly completely observable, there exists a matrix 

K{t) with bounded elements such that the state transition matrix ^c{t, r) oi Ac{t) = 
A{t) - K{t)C'^{t) satisfies 

||<i>c(t,T)||<Aie""i(*-^) 

for some constants ai,(5i, Ai that satisfy ai > -^ > -^, Ai > 0. Let us now rewrite 
(3.3.15), by using what is called "output injection," as 

x={A- KC^)x + Bu + KC^x 

Because C^ x = y — Du, we have 

X = Ac{t)x + Bu + Ky 

where B = B — KD. Following exactly the same procedure as in the proof of 
Lemma 3.3.3, we obtain 

\x{t)\ < ^ {ci\\uth5„ + C2\\yt\\2So) + et 

V2ai - do 

where Ci = supj ||i?(i)||, C2 = supj ||iV'(i)|| and e^ is an exponentially decaying to 
zero term due to a;(0) = xq. Similarly, 

hthso < ,,, , /.^ ^ A ciWuthso + c2\\ythso) + et 

\/(<3i - Oo)(2ai - di) 
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by following exactly the same steps as in the proof of Lemma 3.3.3. The proof of 
(iii) follows directly from the expression of y. □ 

Instead of the interval [0, t), the £25 norm can be defined over any arbi- 
trary interval of time as follows: 

1 
ft 



XtM\\25= (^ e-^(*-^)x^(r)x(r)dTy 



for any ti > and t > ti. This definition allow us to use the properties of 
the C25 norm over certain intervals of time that are of interest. We develop 
some of these properties for the LTI, SISO system 

X = Ax + Bu, x(0) = xq 

y = C^x + Du (3.3.20) 

whose transfer function is given by 

y = [C^{sl - A)-^B + D]u = H{s)u (3.3.21) 

Lemma 3.3.5 Consider the LTI system (3.3.20), where A is a stable matrix 
and u e £2e- Let ao,Ao he the positive constants that satisfy ||e'^(*~'^)|| < 
Aoe~""(*~^''. Then for any constant 5 e [0,(5i) where < 5i < 2ao is 
arbitrary, for any finite ti > and t > ti we have 

... (a) |x(t)| < Aoe-°«(*-*i)|x(ii)|+ci||nt,tJ|25 

(b) ||a:f,tj|25 < coe"2(*-*i)|a:(ii)| + C2\\ut,ti\\2S 

(ii) I|yt,till25 < C3e-i(*-*i)|x(ti)| + \\H{s)\\oo5\\ut,ti\\25 

(iii) Furthermore if D = 0, i.e., H(s) is strictly proper, then 

|y(t)| < C4e-°»(*-*i)|x(ti)| + \\His)\\25\\ut,tA\2S 
where 

noil Aq ||i?||Ao 

ci = ||-d||co, Co = , ^ , C2 - 



V2ao-S' ^(^Si-S){2ao-5i] 

C3=||C^||C0, C4=||C^||Ao 
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Proof Define v{t) as 

Jo if r < ii 

''^^^ = 1 u{t) iir>h 

From (3.3.20) we have 

x{t) = e'^(*"*i)a;(ii) + x{t) Vi > h (3.3.22) 

where 

x{t) = f e'^^*"^'> Bu{T)dT \/t > h 

Jti 

We can now rewrite x{t) as 

x{t) = I e'^^*~^^Bv{T)dT Vi > (3.3.23) 

Similarly 

y{t) = C^e^^'-''^x{ti) + y{t) Vi > h (3.3.24) 

y{t)= I C^e^^*~"''>Bv{T)dT + Dv{t) Vt > (3.3.25) 

Jo 

It is clear that x in (3.3.23) and y in (3.3.25) are the solutions of the system 

^ = Ax + Bv, x(0) = 

y = C'^x + Dv (3.3.26) 

whose transfer function is C^ {si — A)^^B + D = H{s). 

Because A is a stable matrix, there exists constants Aq , ao > such that 

||e'4(t-r)|| < Aoe-°'>(*-^) 

which also implies that H{s) is analytic in Re[s] > —aQ. 

Let us now apply the results of Lemma 3.3.3 to (3.3.26). We have 

\x{t)\ < -j^BL=\\v,hs = c,\\v,hs 
v2ao — 

||x,||2. < ,^ "f'';^° =\\v,hs = c,\\v,hs 
V{(>i - o){2ao - Oi) 

for some Si > 0, 6 > such that < S < Si < 2ao- Because ||wt||2i5 = \\ut,ti \\2S and 
ll^;*,*! ||2<5 < ||2;t||25, it follows that for all t > ti 

\x{t)\ < CiWut^trhs, \\xt,tA\2S < C2\\ut,tA\25 (3.3.27) 

From (3.3.22) we have 

\x{t)\ < Aoe"""(*^*i'|x(ti)| + \x{t)\ Vt > ti 
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which together with (3.3.27) imply {i){a). Using (3.3.22) we have 

\\xt,t A25 < \\{e^^*-'''>x{h))t.Mhs + \\xt,uhs 
which imphes that 

< %^ ^ \x{ti)\ + \\xt,uhs (3.3.28) 

v2ao — 

Prom (3.3.27) and (3.3.28), (i)(b) follows. 

Let us now apply the results of Lemma 3.3.2 to the system (3.3.26), also de- 
scribed by 

y = H{s)v 

we have 

\\yt\\2S<\\H{s)\U\\vt\\2S 

and for H{s) strictly proper 

\m\ < \\H{s)hs\\vt\\2S 
for any < 5 < 2ao. Since \\vt\\25 = \\ut,tr\\2S and ||j/t,tj|25 < Wvths, we have 

\\ytMhs< 11^^(5)1100511^^,1125 (3.3.29) 

and 

\m\<\\H{s)\\2s\\ut^tA\2S, ^t>h (3.3.30) 

From (3.3.24) we have 

\y{t)\ < ||C^||Aoe-""(*-*^)|a:(ii)| + \y{t)l Vi > h (3.3.31) 

which implies, after performing some calculations, that 

\\yt,tj25<\\C^\\ J^ e-l('-'^^\x{t,)\ + \\y,,,J,s, ^t > t, (3.3.32) 

Using (3.3.29) in (3.3.32) we establish (ii) and from (3.3.30) and (3.3.31) we 
establish (iii). □ 

By taking ti = 0, Lemma 3.3.5 also shows the effect of the initial condi- 
tion a;(0) = xo of the system (3.3.20) on the bounds for |y(t)| and ||yt||2<5- 

We can obtain a similar result as in Lemma 3.3.4 over the interval [ti,t] 
by extending Lemma 3.3.5 to the case where A is not necessarily a stable 
matrix and 5 = 60 > is a given fixed constant, provided {C,A) is an 
observable pair. 



3.3. INP UT/0 UTP UT STABILITY 



95 



Lemma 3.3.6 Consider the LTV system (3.3.15) where the elements of 
A{t), B{t), C{t), and D{t) are hounded continuous functions of time and 
whose state transition matrix ^(t,T) satisfies 

||^(t,r)||<Aoe-""(*-") 

Vt > r and t,T ^ [^1,^2) for some t2 > ti > and oq, Aq > 0. Then for any 
5 e [0,(5i) where < 5i < 2aQ is arbitrary, we have 



(i) \xit)\ < Aoe-"(*-*i)|x(ti)| + -^Jut,tA\25 
(ii) ||x,,J|2.<^2|a^e-f(*-*^)|x(ti)|+ ^^" 

where c = sup^ \\B 



V2ao-S I ^ '-'^ -^/(<5i-5){2ao-<5i) 



\ut,tihs,yt e [ti,t2) 



Proof The solution x{t) of (3.3.15) is given by 



x{t) = <^{t,ti)x{ti) + / <^{t,T)B{T)u{T)dT 



k(^)| < Aoe-""(*-*i)|a;(ii)| + cAo / e-""(*-")|u(T)|dT 



Hence, 

Proceeding as in the proof of Lemma 3.3.3 we establish (i). Now 

\\xt,uh5 < Xo\x{h)\( f e''(*-")e-2a„(r-*,)d^Y+cAo||Qt,tJl25 



\Qt,tihs 



A 



-ao(t-T) 



u(r)|rfT 



2<5 



Following exactly the same step as in the proof of Lemma 3.3.3 we establish that 

1 



\\Qt,uh5< 



^{2a„-Si){6i-S) 



\\ut,uhs 



Because 



y'ZaQ — 



2S 



the proof of (ii) follows. 



D 



Example 3.3.3 (i) Consider the system described by 

y = H{s)u 
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where H{s) = -rrg- We have 



s+3' 

4 



ll-H"(s)||oo5 = sup 
and 



juj + :i-l 



6-<5' 



\/S e [0, 6) 



1 I f°° 4 \ 2 

For M(t) = l,Vi > 0, we have y{t) = |(1 — e~'^*), which we can use to verify 
inequality (ii) of Lemma 3.3.2, i.e., 



2,^ -3f - 2 /1-e 



|y(t)| = -|l-e-^*|< 



-5t \2 



3' ' - Ve^^ 

holds Vf e [0, oo) and (5 G (0, 6). 

(ii) The system in (i) may also be expressed as 

y = -^y + 2u, y{0) = 

Its transition matrix ^{t, 0) = e~'^* and from Lemma 3.3.3, we have 

\y{t)\<^^\\uths, V<5e[0,6) 

For u{t) = l,Vt > 0, the above inequality implies 



3' - VG^ 

which holds for all (5 G (0,6). V 

3.3.3 Small Gain Theorem 

Many feedback systems, including adaptive control systems, can be put in 
the form shown in Figure 3.1. The operators Hi,H2 act on 61,62 to pro- 
duce the outputs yi,y2', ui,U2 are external inputs. Sufficient conditions for 
Hi,H2 to guarantee existence and uniqueness of solutions 61,2/1,62,2/2 for 
given inputs ui , U2 in Cpe are discussed in [42] . Here we assume that Hi , H2 
are such that the existence and uniqueness of solutions are guaranteed. The 
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JX^ + ^g^el_ 



H, 



y2 



H2 



Vi 



62/ 



+ 



U2 



+ 



Figure 3.1 Feedback system. 

problem is to determine conditions on Hi,H2 so that if ui,U2 are bounded 
in some sense, then ei,e2,yi,y2 are also bounded in the same sense. 
Let £ be a normed linear space defined by 



A 



C={f:n+^Tl" 



< 00} 



where || • || corresponds to any of the norms introduced earlier. Let Ce be 
the extended normed space associated with C, i.e., 



Ce = {f:n+^ 7^" Ill/til < 00, vt e 7^+ } 



where 



Mr) 



f{r) r<t 

T>t 



The following theorem known as the small gain theorem [42] gives sufficient 
conditions under which bounded inputs produce bounded outputs in the 
feedback system of Figure 3.1. 

Theorem 3.3.3 Consider the system shown in Figure 3.1. Suppose Hi, 
H2: Ce 1-^ Ce! 61,62 e Ce. Suppose that for some constants 71, 72 > and 
Pi, (32, the operators Hi,H2 satisfy 



(-f^iei)tll < 7i||eit|| + f3i 
(^262)* II < 72 II 62* II + P2 

7172 < 1 



Vt e 7^+. // 



then 
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(i) ||eit|| < (1 - 7172)""^ (||uit|| +72||'"2t|| +/32 + 72/3i) 

||e2t|| < (1 -7i72)~"^(||«2t|| +7i||'"it|| +/3i + 71/^2) (3.3.33) 

for any t > 0. 

(ii) If in addition, \\ui\\, \\u2\\ < 00, then £1,62,^1,2/2 have finite norms, and 
the norms of ei, 62 are bounded by the right-hand sides of (3.3.33) with 
all subscripts t dropped. 

The constants 71, 72 are referred to as the gains of Hi, H2 respectively. When 
U2 = 0, there is no need to separate the gain of Hi and H2. In this case, one 
can consider the "loop gain " H2H1 as illustrated by the following corollary: 

Corollary 3.3.4 Consider the system of Figure 3.1 with U2 = 0. Suppose 
that 

||(i:/"2i^iei)t|| < 72i||eit|| + 1321 

||(ffiei)i|| <7i||eit||+/9i 
Vt E TZ'^ for some constants 721,71 > and f32i,(3i- If I21 < 1, then 

(i) 

lleitll < (l-72i)"^(hit||+/32i) 

llyitll < 71(1- 721)"' (||nii||+/32i) + /3i (3.3.34) 

for any t > 0. 

(ii) // in addition \\ui\\ < 00, then 61,62,^1,2/2 have finite norms and 
(3.3.34) holds without the subscript t. 

The proofs of Theorem 3.3.3 and Corollary 3.3.4 follow by using the prop- 
erties of the norm [42] . 

The small gain theorem is a very general theorem that applies to both 
continuous and discrete-time systems with multiple inputs and outputs. 

As we mentioned earlier. Theorem 3.3.3 and Corollary 3.3.4 assume the 
existence of solutions 61,62 G Ce- In practice, ui,U2 are given external 
inputs and 61,62 are calculated using the operators Hi,H2. Therefore, the 
existence of 61, 62 £ Ce depends on the properties of Hi, H2. 

Example 3.3.4 Let us consider the feedback system 
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-^^i(s>^ 



G{s) 



K 



-^^<^W^ 



where G(s) = ^ „ , a > is a constant time delay, and if is a constant feedback 
gain. The external input r is an input command, and d is a noise disturbance. We 
are interested in finding conditions on the gain K such that 

(i) r,d e Ceo ^ £1,62, y e Coo 

(ii) r,de C2^ ei, 62, y e C2 

The system is in the form of the general feedback system given in Figure 3.1, i.e., 

ui = r,U2 = d 



Hiei{t) 



„2q -2(t-T) 



ei(T)dr 



7/262 (<) = Ke2{t) 

where e~^(*~"' for t > a comes from the impulse response g{t) of G{s), i.e., g{t) 
g-2(t-a) for i > a and g{t) = for t < a. 
(i) Because 



\Hiei{t)\ < e^" / 
Jo 



< e 



2a 



o-^(t-r) 



^2(t-r) 



|ei(T)|dr 



drlleitllc 



< ^\\eu\ 



we have 71 = |. Similarly, the Z^oo-gain of H2 is 72 = \K\. Therefore, for Cc 
stability the small gain theorem requires 



\K\ 



<1, 



I.e. 



\K\<2 



(ii) From Lemma 3.3.1, we have 



{Hiei)t\\2 < sup 



-aju) 



2+JLU 



\eit\\2 = ^\\eit\\2 



which implies that the C2 gain of Hi is 71 = |. Similarly the C2 gain of H2 is 
72 = \K\, and the condition for >C2-stability is \K\ < 2. 
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For this simple system, however, with a = 0, we can verify that r,d & Coo =^ 
61:62,2/ G Coo if and only if K > —2, which indicates that the condition given by 
the small gain theorem (for a = 0) is conservative. V 



Example 3.3.5 Consider the system 



B 



where x G 7^", ^ is a stable matrix, i.e., all the eigenvalues of A are in Re[s] < 
and S is a constant matrix. We are interested in obtaining an upper bound for B 
such that Ac is a stable matrix. Let us represent the system in the form of Figure 
3.1 as the following: 




H^ 



We can verify that the £oo gain of Hi is 71 = ^ where ai, ao > are the constants 
in the bound ||e^(*"'^)|| < aie""''^*"^) that follows from the stability of A. The £00 
gain of H2 is 72 = ||-B||. Therefore for Ceo stability, we should have 

11511^ <1 



ao 



or 



|S||< 



ai 



Now Coo stability implies that A^ = A-\- B is a. stable matrix. (Note that the initial 
condition for x is taken to be zero, i.e., a:;(0) = 0.) V 



Despite its conservatism, the small gain theorem is widely used to design 
robust controllers for uncertain systems. In many applications, certain loop 
transformations are needed to transform a given feedback system to the form 
of the feedback system of Figure 3.1 where Hi, H2 have finite gains [42]. 
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3.3.4 Bellman-Gronwall Lemma 

A key lemma for analysis of adaptive control schemes is the following. 

Lemma 3.3.7 (Bellman-Gronwall Lemma I) [232] Let X{t),g{t),k{t) 
he nonnegative piecewise continuous functions of time t. If the function y{t) 
satisfies the inequality 

y{t) < \{t) + g{t) f k{s)y{s)ds, Vt > to > (3.3.35) 

Jto 



then 



y{t) < X{t) + g{t) / X{s)k{s) 

Jto 



exp i / k{T)g{T)dT j 



ds yt>to>o 

(3.3.36) 



In particular, if \{t) = X is a constant and g{t) = 1, then 
y{t) < Xexp ( / k{s)dsj Vt > to > 
Proof Let us define 

U\ ^ 1 /4.\ ~I! 9{-r)HT)dT 

q(t) = k(t)e •'^a 

Because k{i) is nonnegative, we have q{t) > Vt > to- Multiplying both sides of 
(3.3.35) by q{i), and rearranging the inequality we obtain 

q{t)y{t) - q{t)g{t) f k{s)y{s)ds < X{t)q{t) (3.3.37) 

From the expression of q{t), one can verify that 

q{t)y{t) - q{t)g{t) ^ k{s)y{s)ds = ^ {e~ -L ^^^^'^^''^ ^ k{s)y{s)ds^ (3.3.38) 

Using (3.3.38) in (3.3.37) and integrating both sides of (3.3.37), we obtain 

-/; g{r)k{r)dr [\, , , ,, . [\, , , ,. 

e •^'o / k(s)y[s)ds < / \(s)q(s)as 

Jto Jto 

Therefore, 

k{s)y{s)ds < eJ'-o I X{s)q{s)ds 

) Jto 

Jto 

A(s)fc(s)ei'>("^'("^''"ds (3.3.39) 
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Using (3.3.39) in (3.3.35), the proof for the inequality (3.3.36) is complete. 
Consider the special case where A is a constant and 5=1. Define 

A /■* 

gi = A + / k{s)y{s)ds 

Jtn 



From (3.3.35), we have 



Now 



Because fc > 0, we have 



y{t) < qi{t) 
Qi = ky 
qi < kqi 



Let w = qi — kqi. Clearly, w < and 

qi = kqi + w 
which implies 

qi(t) = Jl '^"^'"gi(to) + r ef^ '''■'^'''w{T)dT (3.3.40) 

Jta 

Because fc > 0,w < '^t > to and qi{to) = A, it follows from (3.3.40) that 

f k(T)dT 
y{t) < qi{t) < XeJ^o 

and the proof is complete. □ 

The reader can refer to [32, 232] for alternative proofs of the B-G Lemma. 
Other useful forms of the B-G lemma are given by Lemmas 3.3.8 and 3.3.9. 

Lemma 3.3.8 (B-G Lemma II) Let X{t),k{t) be nonnegative piecewise 
continuous function of time t and let X{t) be differentiable. If the function 
y{t) satisfies the inequality 

y{t) < A(f) + f k{s)y{s)ds, Vt > to > 

then 

yit) < A(to)e^'o ^('^'^' + /* A(s)e/.' ''^^^'^^ds, Vt > to > 0. 
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Proof Let 

z{t) = X{t) + / k{s)y{s)ds 

Jta 

it follows that z is differentiable and z > y. We have 

z = X + ky, z{to) = A(io) 

Let V = z — y, then 

z = X + kz — kv 

whose state transition matrix is 

<J>(t,T) = exp / k{s)ds 



Therefore, 



{t)=^t,to)z{to)+ [ <t>it,T)[X{T)-k{T)v{T)]d7 



It 

Because 

/ <^{t,T)k{T)v{T)dT > 

Jto 

resulting from <J>(i, t), A;(t), i'(r) being nonnegative, we have 

Z{t) < <^{t,to)z{to) + f $(^,T)A(T)dT 
Jto 

Using the expression for <J>(i, to) in the above inequality, we have 
y{t) < z{t) < A(io)e-^''' '^'^'' + /* X{s)e^'' "'"^""^5 

Jto 

and the proof is complete. □ 



Lemma 3.3.9 (B-G Lemma III) Let cq, ci, C2, a be nonnegative constants 
and k(t) a nonnegative piecewise continuous function of time. Ifyit) satisfies 
the inequality 

y{t) < coe-°(*-*«) +CI + C2 f e-''^'-^hiT)yiT)dT, Vt > to 



'to 
then 



Kt) < (CO + ci)e-(*-*°)e^^ X "^'^'^ + era f e-"(*--)e^=^ /* ^^^^'^dr, Vt > to 

Jto 
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Proof The proof follows directly from Lemma 3.3.8 by rewriting the given inequal- 
ity of y as 

m < A(t) + / k{T)y{T)dT 
J to 

where y{t) = e"*y{t),k{t) = C2k{t),X{t) = cge"*" + cie"*. Applying Lemma 3.3.8, 
we obtain 



^Ott..^4\ ^ ( ^. I ^ \ ^Citn J^^ 



V k(s)ds [ ar C2 f* k(s)d. 



e"'y{t) < (Co + ci)e"*'>e ^ ^'o "'^'^^ + c^a / e"^e"^ J. "^'^"^dr 



The result follows by multiplying each side of the above inequality by e " . □ 

The B-G Lemma allows us to obtain an explicit bound for y{t) from the 
implicit bound of y{t) given by the integral inequality (3.3.35). Notice that 
if y{t) > and A(t) = Vt > 0, (3.3.36) implies that y{t) = Vt > 0. 

In many cases, the B-G Lemma may be used in place of the small gain 
theorem to analyze a class of feedback systems in the form of Figure 3.1 as 
illustrated by the following example. 

Example 3.3.6 Consider the same system as in Example 3.3.5. We have 

x{t) = e^*x(0) + / e"^^'-^^ Bx{T)dT 
Jo 

Hence, 

|a;(i)| <aie-"<'*|a;(0)|+ / aie^""(*-^)||B|||a;(r)|dr 



^-ootU/nM _i_ ^,.^-"0*1 



\x{t)\ < aie-°'"'\x{0)\ + aie-^^'^WBll / e°'"^\x{T)\dT 

Jo 

Applying the B-G Lemma I with A = aie-""*|x(0)|,5(i) = ai\\B\\e-°">*,k{t) = e""*, 
we have 

|a;(^)| < aie-""'\x{0)\ + ai|x(0)|e-'^* 

where 

7 = "0 - ai||B|| 

Therefore, for \x{t)\ to be bounded from above by a decaying exponential (which 
implies that ^c = ^4 -|- _B is a stable matrix) , B has to satisfy 

II5II < ^ 
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which is the same condition we obtained in Example 3.3.5 using the small gain 
theorem. In this case, we assume that |a;(0)| 7^ 0, otherwise for x(0) = we would 
have X{t) = and \x{t)\ = Vi > which tells us nothing about the stability of 
Ac- The reader may like to verify the same result using B-G Lemmas II and III. V 



3.4 Lyapunov Stability 

3.4.1 Definition of Stability 

We consider systems described by ordinary differential equations of the form 

x = f(t,x), x(to) = xo (3.4.1) 

where x G 7^", / : J' x B{r) ^TZ, J=[to, 00) and B(r) = {x G 7^" | |x| < r}. 
We assume that / is of such nature that for every xq G B(r) and every 
to £ T^^, (3.4.1) possesses one and only one solution x{t;to,xo). 

Definition 3.4.1 A state Xg is said to be an equilibrium state of the 

system described by (3.4. 1) if 

f(t,Xe) = for all t > to 

Definition 3.4.2 An equilibrium state Xe is called an isolated equilib- 
rium state if there exists a constant r > such that B{xe,r) = {x \ 
\x — Xe\ < r} c 7^" contains no equilibrium state of (3.4.1) other than 

Xg. 

The equilibrium state xie = 0, X2e = of 

xi = X1X2, X2 = x\ 

is not isolated because any point xi = 0, X2 = constant is an equilibrium 
state. The differential equation 

X = (x — 1) X 

has two isolated equilibrium states Xg = 1 and Xg = 0. 
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Definition 3.4.3 The equilibrium state Xe is said to be stable (in the 

sense of Lyapunov) if for arbitrary to and e > there exists a 5(e, to) 
such that \xo — Xe\ < 5 implies \x{t;to,xo) — Xe| < e for all t > Iq. 

Definition 3.4.4 The equilibrium state Xe is said to be uniformly stable 
(u.s.) if it is stable and if 5(e,to) in Definition 3.4-3 does not depend on Iq. 

Definition 3.4.5 The equilibrium state Xe is said to be asymptotically 
stable (a.s.) if (i) it is stable, and (ii) there exists a (5(to) such that \xq — 
Xe\ < S(to) implies linif^oo \x(t; Iq, xq) — Xe\ = 0. 

Definition 3.4.6 The set of all xq e TZ^ such that x(t;to,xo) —i- Xe as 
t ^ oo for some to > is called the region of attraction of the equilibrium 
state Xe. If condition (ii) of Definition 3.4.5 is satisfied, then the equilibrium 
state Xe is said to be attractive. 

Definition 3.4.7 The equilibrium state Xe is said to be uniformly asymp- 
totically stable (u.a.s.) if (i) it is uniformly stable, (ii) for every e > and 
any tg £ T^^ 7 there exist a 5q > independent of to and e and a T(e) > 
independent of to such that \x(t;tQ,XQ) — Xe\ < e for all t > to + T(e) 
whenever \xo — Xe\ < Sq. 

Definition 3.4.8 The equilibrium state Xe is exponentially stable (e.s.) 

if there exists an a > , and for every e > there exists a 5(e) > such 
that 

\x{t; to, xo) - Xe\ < ee""(*"*o^ for all t > to 

whenever \xo — Xe\ < S{e). 

Definition 3.4.9 The equilibrium state Xe is said to be unstable if it is 
not stable. 

When (3.4.1) possesses a unique solution for each xq G "Z^" and to G I^^, 
we need the following definitions for the global characterization of solutions. 

Definition 3.4.10 A solution x(t;tQ,XQ) of (3.4. 1) is bounded if there 
exists a (3 > such that \x{t; to, xo)| < (3 for all t > to, where (3 may depend 
on each solution. 
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Definition 3.4.11 The solutions of (3.4.1) are uniformly bounded (u.h.) 
if for any a > and tg £ Tl^ , there exists a P = P(a) independent of to 
such that if \xo\ < a, then \x{t;to,X(j)\ < for all t > to- 

Definition 3.4.12 The solutions of (3.4.1) are uniformly ultimately bo- 
unded (u.u.b.) (with bound B) if there exists a B > and if corresponding 
to any a > and to E TZ^ , there exists aT = T(a) > (independent of to) 
such that \xo\ < a implies \x{t;to,xo)\ < B for all t>to + T. 

Definition 3.4.13 The equilibrium point Xe of (3.4.1) is asymptotically 
stable in the large (a.s. in the large) if it is stable and every solution 
of (3.4.1) tends to Xe as t —> 00 (i.e., the region of attraction of Xe is all of 
TV). 

Definition 3.4.14 The equilibrium point Xe of (3.4. 1) is uniformly asymp- 
totically stable in the large (u.a.s. in the large) if (i) it is uniformly 
stable, (a) the solutions of (3.4.I) are uniformly bounded, and (Hi) for any 
a > 0, any e > and to £ Tl'^ , there exists T(€,a) > independent of to 
such that if \xo — Xe\ < a then \x(t; to, xq) — Xe\ < e for all t > to + T(e, a). 

Definition 3.4.15 The equilibrium point Xg of (3.4. 1) is exponentially 
stable in the large (e.s. in the large) if there exists a > and for any 

P > 0, there exists k(P) > such that 

\x{t; to, xo)\ < A;(/3)e-"(*-*o) for all t > to 

whenever \xo\ < (3. 

Definition 3.4.16 If x{t;to,Xo) is a solution of x = f{t,x), then the tra- 
jectory x{t;to,xo) is said to be stable (u.s., a.s., u.a.s., e.s., unstable) 

if the equilibrium point Ze = of the differential equation 

z = f{t, z + x{t; to, xo)) - f{t, x{t; to,xo)) 
is stable (u.s., a.s., u.a.s., e.s., unstable, respectively). 

The above stability concepts and definitions are illustrated by the fol- 
lowing example: 



108 CHAPTERS. STABILITY 

Example 3.4.1 

(i) X = has the equihbrium state Xg = c, where c is any constant, which is not 

an isolated equilibrium state. It can be easily verified that a^g = c is stable, 

U.S. but not a.s. 
(ii) X = —x^ has an isolated equilibrium state x^ = 0. Its solution is given by 



x{t) = x{t;to,xo) 



l + 2x^{t-to) 
Now given any e>0, |a;o| < S = e implies that 




'''^*^' = ^' ^ . 2xl{t - t„) ^ l^ol < ^ ^^ ^ ^0 ^0 (3.4.2) 

Hence, according to Definition 3.4.3, Xg = is stable. Because S = e is 
independent of tg, x^ = is also u.s. Furthermore, because a;e = is stable 
and x(t) —> Xe = as t —> oo for all Xq G TZ, we have a.s. in the large. Let 
us now check whether Xg = is u.a.s. in the large by using Definition 3.4.14. 
We have already shown u.s. From (3.4.2) we have that x{t) is u.b. To satisfy 
condition (iii) of Definition 3.4.14, we need to find a T > independent of to 
such that for any a > and e > 0, |a;o| < a implies \x{t)\ < e for all t > to + T. 
From (3.4.2) we have 



\x{t)\<\x{to + T)\ = \l^^^^-^<^^, \/t>to + T 

Choosing T = ^2, it follows that \x{t)\ < e\/t > tQ + T. Hence, Xg = is u.a.s. 

in the large. Using Definition 3.4.15, we can conclude that cCg = is not e.s. 
(iii) X = {x — 2)x has two isolated equilibrium states x,, = and Xg = 2. It can be 
shown that Xg = is e.s. with the region of attraction _/?„ = {a; | a; < 2} and 
Xg = 2 is unstable. 

(iv) X = —jj-j:X has an equilibrium state Xg = that is stable, u.s., a.s. in the large 
but is not u.a.s. (verify). 

(v) X = {t sin t — cos t—2)x has an isolated equilibrium state Xg = that is stable, 
a.s. in the large but not u.s. (verify). V 



3.4.2 Lyapunov's Direct Method 

The stability properties of the equilibrium state or solution of (3.4.1) can 
be studied by using the so-called direct method of Lyapunov (also known 
as Lyapunov's second method) [124, 125]. The objective of this method is 
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to answer questions of stability by using the form of /(t, x) in (3.4.1) rather 
than the explicit knowledge of the solutions. We start with the following 
definitions [143]. 

Definition 3.4.17 A continuous function (p : [0, r] i-^ TZ'^ (or a continuous 
function ip : [0, cx)) i-^ TZ~^) is said to belong to class JC, i.e., (p ^ JC if 

(i) (^(0) = 

(ii) if is strictly increasing on [0, r] (or on [0, oo)J. 

Definition 3.4.18 A continuous function ip : [0, cx)) h^ TZ'^ is said to belong 
to class ICTZ, i.e., ip E ICR. if 

(i) (^(0) = 

(ii) ip is strictly increasing on [0,oo) 

(iii) Ymir^ooP{r) = oo. 

2 

The function 93(|a:|) = tt— 2 belongs to class /C defined on [0, 00) but not to 
class ICTZ. The function </7(|x|) = |x| belongs to class JC and class JCTZ. It is 
clear that ip £ ICTZ implies 99 £ /C, but not the other way. 

Definition 3.4.19 Two functions ipi,ip2 E JC defined on[0,r] (or on[0, 00)) 
are said to be of the same order of magnitude if there exist positive 
constants ki.k2 such that 

ki^iin) < ip2iri) < k2ipi{ri), Vri e [0,r] ( or Vn e [0, 00)) 

2 2 

The function 991 (|x|) = -^^^^2 and ip2 = jr^ ^^^ of the same order of 
magnitude (verify!). 

Definition 3.4.20 A function V{t,x) : TZ+ x B{r) ^ TZ with V{t,0) = 
Vt e TZ'^ is positive definite if there exists a continuous function 99 e /C 
such that V(t,x) > ip(\x\) Vt E TZ'^ , x e B(r) and some r > 0. V{t,x) is 
called negative definite if —V(t,x) is positive definite. 

2 

The function V{t,x) = rz— 2 with x £ B{1) is positive definite, whereas 
V{t,x) = YT^s^^ is not. The function V{t,x) = j^^ is positive definite for 
all X e 7^. 
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Definition 3.4.21 A function V{t,x) : 7^+ x B{r) h^ 7^ with F(t, 0) = 
Vt e TZ'^ is said to be positive (negative) semidefinite if V(t, x) > 

(y(t, x) < 0) for all t e TZ'^ and x e B{r) for some r > 0. 

Definition 3.4.22 A function V{t,x) : 71+ x B{r) ^ TZ with V{t,0) = 
Vt G TZ'^ is said to be decrescent if there exists ip ^ JC such that \V(t,x)\ < 
(/j(|x|) Vt > and \/x e B(r) for some r > 0. 

The function V{t, x) = ^ ^ x"^ is decrescent because V{t, x) = ^ , ^ x"^ < 
x^ Vt e n+ but V{t, x) = tx"^ is not. 

Definition 3.4.23 A function V{t, x) : n+ x W ^^ TZ with V{t, 0) = Vi G 
TZ~^ is said to be radially unbounded if there exists (p G fCTZ such that 
V{t,x) > (p{\x\) for all X G W and t G n+ . 

2 

The function V{x) = tt— 2 satisfies conditions (i) and (ii) of Definition 3.4.23 

(i.e., choose v^da;]) = ttj-pi)- However, because V(x) < f , one cannot find a 
function 93(|a;|) G ICTZ to satisfy V{x) > (p{\x\) for all x £ TZ^. Hence, V is 
not radially unbounded. 

It is clear from Definition 3.4.23 that if V(t, x) is radially unbounded, 
it is also positive definite for all x £ TZ'^ but the converse is not true. The 
reader should be aware that in some textbooks "positive definite" is used for 
radially unbounded functions, and "locally positive definite" is used for our 
definition of positive definite functions. 

Let us assume (without loss of generality) that Xe = is an equilibrium 
point of (3.4.1) and define V to be the time derivative of the function V(t, x) 
along the solution of (3.4.1), i.e., 

V=^ + iVV)^fit,x) (3.4.3) 

where VF = [^-, ^^, • • . , ^^]^ is the gradient of V with respect to x. The 
second method of Lyapunov is summarized by the following theorem. 

Theorem 3.4.1 Suppose there exists a positive definite function V{t,x) : 
TZ'^ X B(r) >-^ TZ for some r > with continuous first-order partial derivatives 
with respect to x, t, and V{t, 0) = Vi G 7^+. Then the following statements 
are true: 
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(i) If V < 0, then Xe = is stable. 
(ii) // V is decrescent and V < 0, then Xe = is u.s. 
(iii) // V is decrescent and F < 0, then Xe is u.a.s. 

(iv) // V is decrescent and there exist ipi,ip2,'^3 £ /C of the same order of 
magnitude such that 

M\x\) < V{t,x) < ^2{\x\), V{t,x) < -(/93(|x|) 

for all X e B(r) and t £ TZ^ , then Xe = is e.s. 

In the above theorem, the state x is restricted to be inside the ball B(r) 
for some r > 0. Therefore, the results (i) to (iv) of Theorem 3.4.1 are 
referred to as local results. Statement (iii) is equivalent to that there exist 
ipi,ip2,(p3 e fC, where ipi,ip2,(p3 do not have to be of the same order of 
magnitude, such that c/9i(|2;|) < V(t,x) < (p2(\x\),V(t,x) < —ip3(\x\). 

Theorem 3.4.2 Assume that (3.4.1) possesses unique solutions for all xq G 
IZ^. Suppose there exists a positive definite, decrescent and radially un- 
bounded function V{t,x) : TZ~^xTZ" >-^ TZ~^ with continuous first- order partial 
derivatives with respect to t,x and V(t,0) = Vt e TZ~^ . Then the following 
statements are true: 

(i) IfV<0, then Xe = is u.a.s. in the large. 

(ii) // there exist (/?i, 992, V's £ A^^ of the same order of magnitude such that 

^l{\x\) < V{t,x) < ^2{\x\), V{t,x) < -V3{\X\) 

then Xe = is e.s. in the large. 

Statement (i) of Theorem 3.4.2 is also equivalent to that there exist 
i^i,ip2 ^ IC and 993 e ICTZ such that 

fi{\x\) < V{t,x) < M\x\), V{t,x) < -V93(|x|), Vx e 7e" 

For a proof of Theorem 3.4.1, 3.4.2, the reader is referred to [32, 78, 79, 

97, 124]. 

Theorem 3.4.3 Assume that (3.4. 1) possesses unique solutions for all xq G 
7^". // there exists a function V(t,x) defined on \x\ > R (where R may 
be large) and t £ [0, 00) with continuous first-order partial derivatives with 
respect to x, t and if there exist '^i,(p2 £ JCTZ such that 
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(i) M\x\)<Vit,x)<ip2i\x\) 

(ii) V{t,x)<0 

for all \x\ > R and t G [0,oo), then, the solutions of (3.4-1) are u.b. If in 
addition there exists c/93 e /C defined on [0, 00) and 

(iii) V(t,x) < — c^3(|x|) for all \x\ > R and t £ [0, 00) 

then, the solutions of (3.4.1) are u.u.b. 

Let us examine statement (ii) of Theorem 3.4.1 where V decrescent and 
V < imply Xe = is u.s. If we remove the restriction of V being decrescent 
in (ii), we obtain statement (i), i.e., V < implies Xg = is stable but not 
necessarily u.s. Therefore, one might tempted to expect that by removing 
the condition of V being decrescent in statement (iii), we obtain Xe = is 
a.s., i.e., V < alone implies Xe = is a.s. This intuitive conclusion is 
not true, as demonstrated by a counter example in [206] where a first-order 
differential equation and a positive definite, nondecrescent function V(t, x) 
are used to show that V < does not imply a.s. 

The system (3.4.1) is referred to as nonautonomous. When the function 
/ in (3.4.1) does not depend explicitly on time t, the system is referred to 
as autonomous. In this case, we write 

X = /(x) (3.4.4) 

Theorem 3.4.1 to 3.4.3 also hold for (3.4.4) because it is a special case of 
(3.4.1). In the case of (3.4.4), however, V{t,x) = ^(x), i.e., it does not 
depend explicitly on time t, and all references to the word "decrescent" and 
"uniform" could be deleted. This is because V{x) is always decrescent and 
the stability (respectively a.s.) of the equilibrium Xg = of (3.4.4) implies 
U.S. (respectively u.a.s.). 

For the system (3.4.4), we can obtain a stronger result than Theo- 
rem 3.4.2 for a.s. as indicated below. 

Definition 3.4.24 A set Q in TZ" is invariant with respect to equation 
(3.4.4) tf every solution of (3.4.4) starting in $1 remains in Q for all t. 

Theorem 3.4.4 Assume that (3.4.4) possesses unique solutions for all xq G 
TZ^. Suppose there exists a positive definite and radially unbounded function 
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V(x) : TZ"^ 1-^ TZ~^ with continuous first-order derivative with respect to x and 
F(0) = 0. // 

(i) F < Vx e 7^" 

(ii) The origin x = is the only invariant subset of the set 

n = [xeW V = o] 

then the equilibrium x^ = of (3.4.4) ^^ o,-^- ^^ ^^6 large. 

Theorems 3.4.1 to 3.4.4 are referred to as Lyapunov-type theorems. The 
function V{t, x) or V{x) that satisfies any Lyapunov-type theorem is referred 
to as Lyapunov function. 

Lyapunov functions can be also used to predict the instability properties 
of the equilibrium state Xe- Several instability theorems based on the second 
method of Lyapunov are given in [232]. 

The following examples demonstrate the use of Lyapunov's direct method 
to analyze the stability of nonlinear systems. 

Example 3.4.2 Consider the system 

xi = X2 + cxi{xl + xl) f3 4 5) 

X2 = —Xi + CX2{x\+ x\) 

where c is a constant. Note that Xg = is the only equilibrium state. Let us choose 

V{x) = xj + xl 

as a candidate for a Lyapunov function. V{x) is positive definite, decrescent, and 
radially unbounded. Its time derivative afong the sofution of (3.4.5) is 

V = 2c{xl + xlf (3.4.6) 

If c = 0, then F = 0, and, therefore, Xg = is u.s.. If c < 0, then V = —2\c\{xl+X2)'^ 
is negative definite, and, therefore, Xe = is u.a.s. in the large. If c > 0, Xg = is 
unstable (because in this case V is strictly increasing Vi > 0), and, therefore, the 
solutions of (3.4.5) are unbounded [232]. V 
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Example 3.4.3 Consider the following system describing the motion of a simple 
pendulum 

*i = ^2, . (3.4.7) 

X2 = —Ksmxi 

where A; > is a constant, Xi is the angle, and X2 the angular velocity. We consider a 
candidate for a Lyapunov function, the function V{x) representing the total energy 
of the pendulum given as the sum of the kinetic and potential energy, i.e., 

1 /"^^ 1 

V{x) = —X2 + k sinry drj = -X2 + fc(l — cos 2:1) 

2 Jo 2 

V{x) is positive definite and decrescent \/x G B^ir) but not radially unbounded. 
Along the solution of (3.4.7) we have 

y = 
Therefore, the equilibrium state Xe = is u.s. \7 

Example 3.4.4 Consider the system 

*' = ""^ .t (3.4.8) 

X2 = —X2 - e Xi 

Let us choose the positive definite, decrescent, and radially unbounded function 

V{x) = xj + xl 

as a Lyapunov candidate. We have 

V = -2x1 + 2a;ia;2(l - e"*) 

Because for this choice of V function neither of the preceding Lyapunov theorems 
is applicable, we can reach no conclusion. So let us choose another V function 

V{t,x) = xl + e*xl 

In this case, we obtain 

V{t,x) = -e*xl 

This V function is positive definite, and V is negative semidefinite. Therefore, 
Theorem 3.4.1 is applicable, and we conclude that the equilibrium state Xg = 
is stable. However, because V is not decrescent, we cannot conclude that the 
equilibrium state Xe = is u.s. V 
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Example 3.4.5 Let us consider the following differential equations that arise quite 
often in the analysis of adaptive systems 

The equilibrium state is Xe = 0,4>e = c, where c is any constant, and, therefore, the 
equilibrium state is not isolated. 

Let us define (j) = (j) — c, so that (3.4.9) is transformed into 

X = —(1 — c)x + (hx 

■ \ ' "^ 3.4.10 

(j) = —X 

We are interested in the stability of the equilibrium point Xg = 0, ^e = c of (3.4.9), 
which is equivalent to the stability of Xg = 0,(/)e = of (3.4.10). We choose the 
positive definite, decrescent, radially unbounded function 

y(x,</.)=- + ^ (3.4.11) 

Then, 

V{x,^) = -(l-c)a;2 

If c > 1, then y > for a; 7^ 0; therefore, Xg = 0, (/)e = is unstable. If, however, 
c < 1, then Xe = 0, (jig = is u.s. For c < 1 we have 

\>(x, 0) = -cqx^ < (3.4.12) 

where cq = 1 — c > 0. From Theorem 3.4.3 we can also conclude that the solutions 
x(t),(j){i) are u.b. but nothing more. We can exploit the properties of V and V, 
however, and conclude that x{t) — > as t — > 00 as follows. 

From (3.4.11) and (3.4.12) we conclude that because V{t) = V {x{t) , (t){t)) is 
bounded from below and is nonincreasing with time, it has a limit, i.e., limt^oo V{i) = 
VoQ. Now from (3.4.12) we have 

* 2._ r.2._no)-Ko 



lim / x dr = x dr = < 00 

*^~ Jo Jo Co 

i.e., X G £2- Because the solution x{t),(j){t) is u.b., it follows from (3.4.10) that 
x G £001 which together with x £ C2 imply (see Lemma 3.2.5) that x{t) ^ as 
t -^ 00. V 

Example 3.4.6 Consider the differential equation 

Xi = -2xi + X1X2 + X2 

X2 = -x\ - Xi 
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2 2 

Consider V{x) = ^ + ^. We have V = —2x\ < and the equilibrium Xig = 
0,X2e = is U.S. The set defined in Theorem 3.4.4 is given by 

n = {a;i,a;2 | a;i = 0} 

Because xi = X2 on f2, any solution that starts from fi with 2:2 7^ leaves f2. 
Hence, xi = 0,X2 = is the only invariant subset of il. Therefore the equilibrium 
xie = 0, X2e = is a.s. in the large. V 

In the proceeding examples, we assume implicitly that the differential 
equations considered have unique solutions. As indicated in Section 3.4.1, 
this property is assumed for the general differential equation (3.4.1) on which 
all definitions and theorems are based. The following example illustrates that 
if the property of existence of solution is overlooked, an erroneous stability 
result may be obtained when some of the Lyapunov theorems of this section 
are used. 

Example 3.4.7 Consider the second-order differential equation 

Xi = —2x\ — a;2Sgn(a;i), Xi(0) = 1 
±2 = |a;i|, X2(0) = 



where 



The function 



/ \ ] 1 if xi > 
sgn(xi)=^ -1 ifa;i<0 



V{xx,X2) = x\ + x\ 
has a time derivative V along the solution of the differential equation that satisfies 

V{x-Y,X2) = -Axl < 

Hence, according to Theorem 3.4.1, a;i,X2 G Coo and the equilibrium xie = 0,X2e = 
is U.S. Furthermore, we can show that Xi(i) — > as i — > oo as follows: Because 
V > and y < we have that limt_^oo V{xi{t),X2{t)) = Voo for some Voo G TZ^ ■ 

Hence, 

t 

4xl{T)dT = V{x,{0),X2m - V{x,{t),X2{t)) 


which implies that 

4 / xl{T)dT < oo 
Jo 
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i.e., xi e £2- From a;i,a;2 G £00 we have that Xi G £00, which together with 
xi G C2 and Lemma 3.2.5 imply that xi{t) —> as t —> c». 

The above conclusions are true provided continuous functions xi{t),X2{t) with 
xi(0) = 1 and X2{0) = satisfying the differential equation for all t e [0,c») exist. 
However, the solution of the above differential equation exists only in the time 
interval t G [0, 1], where it is given by xi{t) = (1 — i)e~*, a;2(i) = ie~*. The difficulty 
in continuing the solution beyond t = I originates from the fact that in a small 
neighborhood of the point (a;i(l), 0:2(1)) = (0,e~^), Xi = — 2a;i — a;2Sgn(a;i) < if 
xi > and ii > if xi < 0. This causes xi to change sign infinitely many times 
around the point (0,e^^), which implies that no continuous functions xi{t),X2{t) 
exist to satisfy the given differential equation past the point t = I. \7 

The main drawback of the Lyapunov's direct method is that, in general, 
there is no procedure for finding the appropriate Lyapunov function that 
satisfies the conditions of Theorems 3.4.1 to 3.4.4 except in the case where 
(3.4.1) represents a LTI system. If, however, the equilibrium state Xg = of 
(3.4.1) is u.a.s. the existence of a Lyapunov function is assured as shown in 
[139]. 

3.4.3 Lyapunov-Like Functions 

The choice of an appropriate Lyapunov function to establish stability by 
using Theorems 3.4.1 to 3.4.4 in the analysis of a large class of adaptive 
control schemes may not be obvious or possible in many cases. However, a 
function that resembles a Lyapunov function, but does not possess all the 
properties that are needed to apply Theorems 3.4.1 to 3.4.4, can be used to 
establish some properties of adaptive systems that are related to stability 
and boundedness. We refer to such a function as the Lyapunov-like function. 
The following example illustrates the use of Lyapunov-like functions. 

Example 3.4.8 Consider the third-order differential equation 

ii = -xi - a;2X3, a;i(0)=a;io 

a;2 = xixa, ^2(0) = 2:20 (3.4.13) 

±3 = xl, a;3(0) = X30 

which has the nonisolated equilibrium points in TZ^ defined by Xi = 0, a;2 = constant, 
3:3 = or Xl = 0,X2 = 0,X3 = constant. We would like to analyze the stability 
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properties of the solutions of (3.4.13) by using an appropriate Lyapunov function 
and applying Theorems 3.4.1 to 3.4.4. If we follow Theorems 3.4.1 to 3.4.4, then we 
should start with a function V{xi, X2, x^) that is positive definite in 7^"^. Instead of 
doing so let us consider the simple quadratic function 

2 2 

V{x,,X2) = ^ + f 

which is positive semidefinite in TZ^ and, therefore, does not satisfy the positive 
definite condition in TZ^ of Theorems 3.4.1 to 3.4.4. The time derivative of V along 
the solution of the differential equation (3.4.13) satisfies 

V = -xl<0 (3.4.14) 

which implies that T^ is a nonincreasing function of time. Therefore, 

V{xi{t),X2{t)) < y(xi(0),X2(0)) = Vo 

and y, a;i,a;2 G C^c- Furthermore, V has a limit as f ^ oo, i.e., 



lim V{xi{t),X2{t)) = V^ 

t — *oo 



and (3.4.14) implies that 



t 

2/ 



xi{T)dT = Vo-V{t), \/t>0 
and 

/•oo 
/ xl{T)dT = Vb - Foo < OO 

Jo 
i.e., Xi e £2- From Xi G C2 we have from (3.3.13) that 0:3 G Cqo and from 
a;i,a;2,a^3 G 'Coo that xi G Ceo- Using Xi G £00, xi G £2 and applying Lemma 3.2.5 
we have Xi(i) — > as i — > cxd. By using the properties of the positive semidefinite 
function V{xi,X2), we have established that the solution of (3.4.13) is uniformly 
bounded and xi{t) — > as i — > 00 for any finite initial condition a;i(0), a;2(0), 
0:3(0). Because the approach we follow resembles the Lyapunov function approach, 
we are motivated to refer to V{xi, X2) as the Lyapunov-like function. In the above 
analysis we also assumed that (3.4.13) has a unique solution. For discussion 
and analysis on existence and uniqueness of solutions of (3.4.13) the reader 
is referred to [191]. V 

We use Lyapunov-like functions and similar arguments as in the example 
above to analyze the stability of a wide class of adaptive schemes considered 
throughout this book. 



3.4. LYAPUNOV STABILITY 119 

3.4.4 Lyapunov's Indirect Method 

Under certain conditions, conclusions can be drawn about the stability of the 
equilibrium of a nonlinear system by studying the behavior of a certain linear 
system obtained by linearizing (3.4.1) around its equilibrium state. This 
method is known as the first method of Lyapunov or as Lyapunov's indirect 
method and is given as follows [32, 232]: Let Xg = be an equilibrium state 
of (3.4.1) and assume that f{t,x) is continuously differentiable with respect 
to X for each t > 0. Then in the neighborhood of x^ = 0, f has a Taylor 
series expansion that can be written as 

x = f{t,x) = A{t)x + fi{t,x) (3.4.15) 

where A{t) = V/ \x=o is referred to as the Jacobian matrix of / evaluated 
at X = and /i(t, x) represents the remaining terms in the series expansion. 

Theorem 3.4.5 Assume that A(t) is uniformly bounded and that 

lim sup —j = 

\x\^Ot>0 \x\ 

Let Ze = be the equilibrium of 

z{t) = A(t)z(t) 

The following statements are true for the equilibrium Xe = of (3.4.15): 

(i) If Ze = is u.a.s. then Xe = is u.a.s. 
(ii) If Ze = is unstable then Xe = is unstable 

(iii) If Ze = is U.S. or stable, no conclusions can be drawn about the 
stability of Xe = 0. 

For a proof of Theorem 3.4.5 see [232]. 

Example 3.4.9 Consider the second-order differential equation 

mx = — 2/i(a; — l)x — kx 

where m,^, and k are positive constants, which is known as the Van der Pol os- 
cillator. It describes the motion of a niass-spring-daniper with damping coefficient 
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2^{x^ — 1) and spring constant k, where x is the position of the mass. If we define 
the states xi = x,X2 = x, we obtain the equation 



X 


1 = 


X2 








X2 = 


k 
Xl - 

m 


'A4 

m 


which has an equilibrium at Xi 


e = 0,X2e 


= 0. 


around (0, 0) gives us 








Z2 


= 




_ A 

m 


1 

2a< 
rn . 





0. The linearization of this system 



zi 

Z2 



Because m,^ > at least one of the eigenvalues of the matrix A is positive and 
therefore the equilibrium (0, 0) is unstable. \7 



3.4.5 Stability of Linear Systems 

Equation (3.4.15) indicates that certain classes of nonlinear systems may be 
approximated by linear ones in the neighborhood of an equilibrium point or, 
as often called in practice, operating point. For this reason we are interested 
in studying the stability of linear systems of the form 



x{t) = A{t)x{t) 



(3.4.16) 



where the elements of A(t) are piecewise continuous for all t > to > 0, as a 
special class of the nonlinear system (3.4.1) or as an approximation of the 
linearized system (3.4.15). The solution of (3.4.16) is given by [95] 

x(t;to,xo) = ^{t,to)xo 

for all t > to, where $(t,to) is the state transition matrix and satisfies the 
matrix differential equation 

d 



dt 



<^{t,to) = A{t)^{t,to), yt>to 



^{to,to) = I 
Some additional useful properties of $(t,to) are 

(i) ^(t,to) = ^(i, T)^(r, to) Vt > r > to (semigroup property) 

(ii) $(t,to)-i = $(to,t) 

(iii) ^$(t,to) = -^(t,to)^(to) 
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Necessary and sufficient conditions for the stability of the equihbrium state 
Xe = of (3.4.16) are given by the following theorems. 

Theorem 3.4.6 Let ||$(i,r)|| denote the induced matrix norm of^{t,T) at 
each time t > t. The equilibrium state Xe = of (3.4.16) is 

(i) stable if and only if the solutions of (3.4.16) are bounded or equivalently 

c(to) = sup||$(i,to)|| <oo 

t>to 

(ii) U.S. if and only if 

Co = sup c(to) = sup sup ||$(t, to)|| < CO 
to>0 to>0 \t>to / 



(iii) a.s. if and only if 



lim ||$(t,to)||=0 

t— >oo 



for any tg £ T^'^ 
(iv) u.a.s. if and only if there exist positive constants a and P such that 

\mt,to)\\ < ae-'^^'-'°\ Vt>to>0 

(v) e.s. if and only if it is u.a.s. 

(vi) a.s., u.a.s., e.s. in the large if and only if it is a.s., u.a.s., e.s., respec- 
tively. 

Theorem 3.4.7 [1] Assume that the elements of A(t) are u.b. for all t £ 
TZ'^ . The equilibrium state Xg = of the linear system (3.4.16) is u.a.s. if 
and only if, given any positive definite matrix Q{t), which is continuous in 
t and satisfies 

< ci/ < Q{t) <C2l<00 

for all t > to, the scalar function defined by 

$^(T,t)Q(r)$(T,t) dr X (3.4.17) 

exists (i.e., the integral defined by (3.4.17) is finite for finite values of x and 
t) and is a Lyapunov function of (3.4.16) with 

V{t,x) = -x'^Q(t)x 
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It follows using the properties of $(t, to) that P{t) = J^^\t, t)Q{T)^{T, t)dT 
satisfies the equation 

P{t) = -Q{t) - A'^{t)P{t) - P{t)A{t) (3.4.18) 

i.e., the Lyapunov function (3.4.17) can be rewritten as V{t,x) = x^ P{t)x, 
where P{t) = P'^ {t) satisfies (3.4.18). 

Theorem 3.4.8 A necessary and sufficient condition for the u.a.s of the 
equilibrium Xe = of (3.4-16) is that there exists a symmetric matrix P{t) 
such that 

111 < P{t) < 72/ 

P{t) + A'^{t)P{t) + P{t)A{t) + vC{t)C'^{t) < O 

are satisfied Vt > and some constant i/ > 0, where 71 > 0, 72 > are con- 
stants and C(t) is such that {C{t), A(t)) is a UCO pair (see Definition 3.3.3). 

When A(t) = ^ is a constant matrix, the conditions for stability of the 
equilibrium Xg = of 

x = Ax (3.4.19) 

are given by the following theorem. 

Theorem 3.4.9 The equilibrium state Xe = of (3.4.19) is stable if and 
only if 

(i) All the eigenvalues of A have nonpositive real parts. 

(ii) For each eigenvalue Aj with RejAj} = 0, A^ is a simple zero of the 

minimal polynomial of A (i.e., of the monic polynomial tpi^X) of least 

degree such that ^(A) = O). 

Theorem 3.4.10 A necessary and sufficient condition for Xe = to be a.s. 
in the large is that any one of the following conditions is satisfied ^ : 

(i) All the eigenvalues of A have negative real parts 



^Note that (iii) includes (ii). Because (ii) is used very often in this book, we list it 
separately for easy reference. 
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(ii) For every positive definite matrix Q, the following Lyapunov matrix 
equation 

a'^p + pa = -Q 

has a unique solution P that is also positive definite. 
(iii) For any given matrix C with (C, A) observable, the equation 

a'^p + pa = -C^C 

has a unique solution P that is positive definite. 

It is easy to verify that for the LTI system given by (3.4.19), if Xg = is 
stable, it is also u.s. If Xg = is a.s., it is also u.a.s. and e.s. in the large. 

In the rest of the book we will abuse the notation and call the matrix 
A in (3.4.19) stable when the equilibrium Xg = is a.s., i.e., when all the 
eigenvalues of A have negative real parts and marginally stable when Xg = 
is stable, i.e., A satisfies (i) and (ii) of Theorem 3.4.9. 

Let us consider again the linear time- varying system (3.4.16) and suppose 
that for each fixed t all the eigenvalues of the matrix A{t) have negative real 
parts. In view of Theorem 3.4.10, one may ask whether this condition for 
A(t) can ensure some form of stability for the equilibrium Xg = of (3.4.16). 
The answer is unfortunately no in general, as demonstrated by the following 
example given in [232]. 

Example 3.4.10 Let 

— 1 + 1.5 cos^i 1 — 1.5 sin t cost 



A(i) 



-1 — 1.5sinicos i —1 + 1. 5 sin t 



The eigenvalues of A(t) for each fixed i, 



\{A(t)) = -.25 + j.5\/r75 

have negative real parts and are also independent of t. Despite this the equilibrium 
Xe = of (3.4.16) is unstabie because 

e'^*cosi e~*sini 



-e'^*sint e *cost 



$(i,0) = 
is unbounded w.r.t. time t. V 
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Despite Example 3.4.10, Theorem 3.4.10 may be used to obtain some 
sufficient conditions for a class of A(t), which guarantee that Xg = of 
(3.4.16) is u.a.s. as indicated by the following theorem. 

Theorem 3.4.11 Let the elements of A(t) in (3.4-16) be differentiable^ and 
bounded functions of time and assume that 

(Al) Re{Xi{A{t))} < -as Vt > and for i = 1,2,. . . ,n where as > is 
some constant. 

(i) // ll^ll e C2, then the equilibrium state Xe = of (3.4. 16) is u.a.s. in 
the large. 

(ii) // any one of the following conditions: 

(a) Jl+^\\Air)\\dT<fiT + ao, i.e., (||i||)l £ 5(^) 

(b) //+^||i(T)fdT</.2r + ao, I.e., ||i|| e5(M^) 

(c) ||i(t)||</^ 

is satisfied for some ao, fi E TZ~^ and Vt > 0, T > 0, then there exists a 
fi* > such that if n E [0,/x*), the equilibrium state Xe of (3. 4. 16) is 
u.a.s. in the large. 

Proof Using (Al), it follows from Theorem 3.4.10 that the Lyapunov equation 

A^{t)P{t) + P{t)A{t) = -I (3.4.20) 

has a unique bounded solution P{t) for each fixed t. We consider the following 
Lyapunov function: 

V{t,x) = x'^P{t)x 

Then along the solution of (3.4.16) we have 

V = -\x{t)\^ + x'^{t)P{t)x{t) (3.4.21) 

From (3.4.20), P satisfies 

A^{t)P{t) + P{t)A{t) = -Q{t), Vi>0 (3.4.22) 

where Q{t) = A'^{t)P{t) + P{t)A{t). Because of (Al), it can be verified [95] that 

/•CO 

P{t)= / e^^(*)"Q(i)e^(*)^dT 



The condition of differentiability can be relaxed to Lipschitz continuity. 
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satisfies (3.4.22) for each t > 0, therefore, 

/•OO 

\\Pm<\\Qm / lle^'Wnille^Wnidr 



Because (Al) inipUes that ||e^*''^|| < aie """^ for some ai,ao > it follows that 

mm < c\\Qm 

for some c > 0. Then, 

||Q(i)||<2||P(f)||||i(i)|| 

together with P G C^c imply that 

\\P{t)\\<(3\\A{t)\\, Vi>0 (3.4.23) 

for some constant /3 > 0. Using (3.4.23) in (3.4.21) and noting that P satisfies 
< /3i < X„iin{P) < Xmax{P) < 02 for some Pi,l32 > 0, we have that 

V{t) < -\x{t)\' + m{t)\Mt)\' < -fi-^V{t) + Pf3Y'\\A{t)\\V{t) 

therefore, 

V{t)<e ■'''> ' V{to) (3.4.24) 

Let us prove (ii) first. Using condition (a) in (3.4.24) we have 

V{t) < e-(^2"'-^^rV)(*-*o)g/3/3r^aoy(i^) 

Therefore, for fj,* = -k^ and V^ G [0, /i*), V{t) — > exponentially fast, which implies 
that Xe = is u.a.s. in the large. 

To be able to use (b), we rewrite (3.4.24) as 

y(,)<e-^.-^(*-*o)e^^^"^/;"-^(^)"'^V(i„) 
Using the Schwartz inequality and (b) we have 

j\\A{T)\\dr < (^j\\A{T)rdTy Vr^To 

< ^i{t - to) + y/a^\/t - to 

Therefore, 

V{t) < e-"(*-*")2/(t)y(io) 
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where a = (1 — 7)/3^ — /3/3f n, 

y(t) = exp[-7/32-i(t-to) + /3/3r'V^yf^^] 



exp 






and 7 is an arbitrary constant that satisfies < 7 < 1. It can be shown that 



y(t) < exp 
hence, 



"0 



47/3? J 



= c Vi > to 



Choosing /i* = g Ij' , we have that V/i G [0,/i*), a > and, therefore, V{t) — > 
exponentially fast, which implies that Xg = is u.a.s in the large. 

Since (c) implies (a), the proof of (c) follows directly from that of (a). 

The proof of (i) follows from that of (ii)(b), because \\A\\ G C2 implies (b) with 
^ = 0. D 



In simple words, Theorem 3.4.11 states that if the eigenvalues of A(t) 
for each fixed time t have negative real parts and if A(t) varies sufficiently 
slowly most of the time, then the equilibrium state Xe = of (3.4.16) is u.a.s. 

3.5 Positive Real Functions and Stability 

3.5.1 Positive Real and Strictly Positive Real Transfer Func- 
tions 

The concept of PR and SPR transfer functions plays an important role in the 
stability analysis of a large class of nonlinear systems, which also includes 
adaptive systems. 

The definition of PR and SPR transfer functions is derived from network 
theory. That is, a PR (SPR) rational transfer function can be realized as 
the driving point impedance of a passive (dissipative) network. Conversely, a 
passive (dissipative) network has a driving point impedance that is rational 
and PR (SPR). A passive network is one that does not generate energy, i.e., a 
network consisting only of resistors, capacitors, and inductors. A dissipative 
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network dissipates energy, which iniphes that it is made up of resistors and 
capacitors, inductors that are connected in parallel with resistors. 

In [177, 204], the following equivalent definitions have been given for PR 
transfer functions by an appeal to network theory. 

Definition 3.5.1 A rational function G(s) of the complex variable s = a + 
jio is called PR if 

(i) G(s) is real for real s. 

(ii) Re[G(s)] > for all Re[s] > 0. 

Lemma 3.5.1 A rational proper transfer function G(s) is PR if and only if 

(i) G(s) is real for real s. 

(ii) G(s) is analytic in Re[s] > 0, and the poles on the juj-axis are simple 

and such that the associated residues are real and positive. 
(iii) For all real value to for which s = jiv is not a pole of G(s), one has 

Re[G{juj)] > 0. 

For SPR transfer functions we have the following Definition. 

Definition 3.5.2 [177] Assume that G(s) is not identically zero for all s. 
Then G{s) is SPR if G{s - e) is PR for some e > 0. 

The following theorem gives necessary and sufficient conditions in the fre- 
quency domain for a transfer function to be SPR: 

Theorem 3.5.1 [89] Assume that a rational function G(s) of the complex 
variable s = a + juj is real for real s and is not identically zero for all s. Let 
n* be the relative degree of G{s) = Z{s)/R{s) with \n*\ < 1. Then, G{s) is 
SPR if and only if 

(i) G{s) is analytic in Re[s] > 

(ii) Re[G(jw)] > 0, Vlj e (-00,00) 

(iii) (a) When n* = 1, lim\^\^^uj^Re[G{juj)] > 0. 
(b) When n* = -1, lim|^|^^ ^ > 0. 
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It should be noted that when n* = 0, (i) and (ii) in Theorem 3.5.1 are 
necessary and sufficient for G(s) to be SPR. This, however, is not true for 
n* = 1 or —1. For example, 

G(s) = {s + a + /3)/[(s + a)(s + /?)] 

a, P > satisfies (i) and (ii) of Theorem 3.5.1, but is not SPR because it 
does not satisfy (iiia). It is, however, PR. 

Some useful properties of SPR functions are given by the following corol- 
lary. 

Corollary 3.5.1 (i) G(s) is PR (SPR) if and only if 1/G(s) is PR (SPR) 
(ii) If G{s) is SPR, then, \n*\ < 1, and the zeros and poles of G{s) lie in 

Re[s] < 
(iii) If\n*\ > 1, then G{s) is not PR. 

A necessary condition for G(s) to be PR is that the Nyquist plot of G{jlo) 
lies in the right half complex plane, which implies that the phase shift in the 
output of a system with transfer function G{s) in response to a sinusoidal 
input is less than 90°. 

Example 3.5.1 Consider the following transfer functions: 

(i) G,{s) = -^^, (ii) G^{s) ^ 



(s + 2)2' "■ ' '"■ ' (s + 2)2 

(i") ^3(^)= , 'l^^^y (iv) G,{s) = ^ 
[s + l)(s + 2) s + a 

Using Corollary 3.5.1 we conclude that Gi{s) is not PR, because 1/Gi{s) is not 
PR. We also have that G2{s) is not PR because n* > 1. 
For 6*3(5) we have that 

Re[G3(ja;)] = ^.^ „ ^ > 0, Muj e (-00, 00) 

which together with the stability of G^{s) implies that G^{s) is PR. Because G^{s) 
violates (iii) (a) of Theorem 3.5.1, it is not SPR. 

The function Gi{s) is SPR for any a > and PR, but not SPR for a = 0. V 



The relationship between PR, SPR transfer functions, and Lyapunov sta- 
bility of corresponding dynamic systems leads to the development of several 
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stability criteria for feedback systems with LTI and nonlinear parts. These 
criteria include the celebrated Popov's criterion and its variations [192]. The 
vital link between PR, SPR transfer functions or matrices and the existence 
of a Lyapunov function for establishing stability is given by the following 
lemmas. 

Lemma 3.5.2 (Kalman-Yakubovich-Popov (KYP) Lemma) [7, 192] 
Given a square matrix A with all eigenvalues in the closed left half complex 
plane, a vector B such that (A, B) is controllable, a vector C and a scalar 
(i > 0, the transfer function defined by 

G{s) = d + C^{sI-A)-^B 

is PR if and only if there exist a symmetric positive definite matrix P and 
a vector q such that 

A'^P + PA= -qq~^ 

PB-C = ±(V2d)q 

Lemma 3.5.3 (Lefschetz-Kalman-Yakubovich (LKY) Lemma) [89, 
126] Given a stable matrix A, a vector B such that (A, B) is controllable, a 
vector C and a scalar d > 0, the transfer function defined by 

G{s) = d + C^{sI-A)-^B 

is SPR if and only if for any positive definite matrix L, there exist a sym- 
metric positive definite matrix P, a scalar v > and a vector q such that 

A'^P + PA= -qq~^ - vL 

PB-C = ±q\/2d 

The lemmas above are applicable to LTI systems that are controllable. This 
controllability assumption is relaxed in [142, 172]. 

Lemma 3.5.4 (Meyer-Kalman-Yakubovich (MKY) Lemma) Given 
a stable matrix A, vectors B, C and a scalar d > 0, we have the following: 

If 

G{s) = d + C^{sI-A)-^B 
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is SPR, then for any given L = L > 0, there exists a scalar u > 0, a vector 
q and a P = P > such that 

A'^P + PA= -qq" - vL 

PB-C = ±q\/2d 

In many applications of SPR concepts to adaptive systems, the transfer 
function G(s) involves stable zero-pole cancellations, which implies that the 
system associated with the triple (A, B, C) is uncontrollable or unobservable. 
In these situations the MKY lemma is the appropriate lemma to use. 

Example 3.5.2 Consider the system 

y = G{s)u 

where G{s) = 7jt^y(s+2)' ^^ would like to verify whether G{s) is PR or SPR by 
using the above lemmas. The system has the state space representation 



where 







1 



X 


= Ax + Bu 


y 


= C^x 


3 


, B = 


■ ■ 

1 



c 



-2 
According to the above lemmas, if G{s) is PR, we have 

PB = C 

which implies that 

P 



Pi 3 
3 1 



for some pi > that should satisfy pi — 9 > for P to be positive definite. We 
need to calculate pi , z^ > and q such that 



A' P+PA= -qq ' 

is satisfied for any L = L^ > 0. We have 

12 11 -pi 

11 -Pi 



i^L 



-qq 



(3.5.1) 



i/L 



12 11 -pi 

11 -Pi 

for pi 7^ 11. Because no pi > 9 exists for which Q is positive definite, no j^ > can 



Now Q 



is positive semidefinite for pi = 11 but is indefinite 
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be found to satisfy (3.5.1) for any given L = L^ > 0. Therefore, G{s) is not SPR, 
something we have already verified in Example 3.5.1. For pi = 11, we can select 
v = {) snAq= [^12, 0]^ to satisfy (3.5.1). Therefore, G{s) is PR. V 

The KYP and MKY Lemmas are useful in choosing appropriate Lya- 
punov or Lyapunov-like functions to analyze the stability properties of a 
wide class of continuous-time adaptive schemes for LTI plants. We illustrate 
the use of MKY Lemma in adaptive systems by considering the stability 
properties of the system 

e = A^e + BcO^uj 

e = -TeiLO (3.5.2) 

ei = C^e 

that often arises in the analysis of a certain class of adaptive schemes. In 
(3.5.2), r = r^ > is constant, e G 7^™,6l G 7^",el e TZ^ and co = Cje + 
Cj Brn, where e^ is continuous and e^ £ £00 • The stability properties of 
(3.5.2) are given by the following theorem. 

Theorem 3.5.2 // Ac is a stable matrix and G{s) = C^ {sl — Ac)~^Bc is 
SPR, then e,9,uj ^ Coo; e,6 & Coo 0^2 and e(t), ei(i), 9(t) —i- as t —i- 00. 

Proof Because we made no assumptions about the controllability or observability 
of {Ac, Bc,Cc), we concentrate on the use of the MKY Lemma. We choose the 
function 

V{e,9) = e^Pe + d^T-^9 



where P = P^ > satisfies 

AjP + PAc = -qq^ - vL 
PBc = C 

for some vector q, scalar i^ > and L = L^ > guaranteed by the SPR property 
of G{s) and the MKY Lemma. Because uj = Cq e + Cj Cm and e^ G Coo can be 
treated as an arbitrary continuous function of time in Coo, we can establish that 
V{e, 9) is positive definite in TS.""*"™, and y is a Lyapunov function candidate. 
The time derivative of V along the solution of (3.5.2) is given by 

V = -e^qq^e - ve^ Le < 
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which by Theorem 3.4.1 implies that the equihbrium eg, ^g = is u.s. and ei, e, G 
Coo- Because uj = Cq e + Cj Cm and Cm & i^oo, we also have lo G Coo- By exploit- 
ing the properties of V , V further, we can obtain additional properties about the 
solution of (3.5.2) as follows: From V^ > and V^ < we have that 

lim V{e{t),e{t)) = Voo 

t — ^OO 



and, therefore. 



fOQ 

V / e^Ledr < Vb - V^c 

-'0 



where Vq = V{e{0),9{0)). Because i'\„iin{L)\e\'^ < ve^ Le, it follows that e G £2- 
From (3.5.2) we have \0{t)\ < ||r|| |ei||aj|. Since uj G C^o and ei G Coo 0^2 it follows 
from Lemma 3.2.3 (ii) that G Coof]C2- Using e,6,uj G £00 we obtain e G £00, 
which together with e G £2, implies that e(i) — > as i — > 00. Hence, ei, 0, e ^ as 
t -^ 00, and the proof is complete. □ 

The arguments we use to prove Theorem 3.5.2 are standard in adaptive 
systems and will be repeated in subsequent chapters. 

3.5.2 PR and SPR Transfer Function Matrices 

The concept ol PR transfer functions can be extended to PR transfer function 
matrices as follows. 

Definition 3.5.3 [7, 172] Annxn matrix G{s) whose elements are rational 
functions of the complex variable s is called PR if 

(i) G{s) has elements that are analytic for Re[s] > 

(ii) G*(s) = G(s*) /orRe[s] >0 

(iii) G {s*) + G{s) is positive semidefinite for Re[s] > 

where * denotes complex conjugation. 

Definition 3.5.4 [7] An n x n matrix G(s) is SPR if G{s — e) is PR for 
some e > 0. 

Necessary and sufficient conditions in the frequency domain for G{s) to be 
SPR are given by the following theorem. 
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Theorem 3.5.3 [215] Consider the n x n rational transfer matrix 

G{s) = C^{sI-A)-^B + D (3.5.3) 

where A, B, C , and D are real matrices with appropriate dimensions. As- 
sume thatG{s) + G^{—s) has rankn almost everywhere in the complex plane. 
Then G(s) is SPR if and only if 

(i) all elements of G{s) are analytic in Re[,s] > 0. 
(ii) G{juj) + C^i-juj) > Vw e 7^. 



^'iiniA..^ ^G^(-jcj)] >0, D + Z)"^ > "■^-'"^rn , nTi 



(iii) (a) lim oj\Gijuj) + G^i-juj)] >0, D + D'^ >0 ifdet[D + D'^] = 0. 



(b) lim [G(JLo) + G ' (-jcj)] > if detlD + D ' ] / 0. 

Necessary and sufficient conditions on the matrices A,B,C, and D in 
(3.5.3) for G(s) to be PR, SPR are given by the following lemmas which are 
generalizations of the lemmas in the SISO case to the MIMO case. 

Theorem 3.5.4 [215] Assume that G(s) given by (3.5.3) is such that G{s) + 
G^{—s) has rankn almost everywhere in the complex plane, det(s/ — ^) has 
all its zeros in the open left half plane and (A, B) is completely controllable. 
Then G{s) is SPR if and only if for any real symmetric positive definite 
matrix L, there exist a real symmetric positive definite matrix P, a scalar 
1/ > 0, real matrices Q and K such that 

A~^P + PA = -QQ^ - vL 

PB = C±QK 

K^K = D'^ + D 

Lemma 3.5.5 [177] Assume that the transfer matrix G{s) has poles that 
lie in Re[s] < —7 where 7 > and (A, B, C, D) is a minimal realization of 
G{s). Then, G{s) is SPR if and only if a matrix P = P~^ > 0, and matrices 
Q,K exist such that 

A'^P + PA = -QQ^ - 27P 

PB = G±QK 

K^K = D + D^ 
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Figure 3.2 General feedback system. 

The SPR properties of transfer function matrices are used in the analysis 
of a class of adaptive schemes designed for multi-input multi-output (MIMO) 
plants in a manner similar to that of SISO plants. 



3.6 Stability of LTI Feedback Systems 

3.6.1 A General LTI Feedback System 

The block diagram of a typical feedback system is shown in Figure 3.2. Here 
Go{s) represents the transfer function of the plant model and C{s),F(s) are 
the cascade and feedback compensators, respectively. The control input u 
generated from feedback is corrupted by an input disturbance du to form the 
plant input uq. Similarly, the output of the plant yo is corrupted by an output 
disturbance d to form the actual plant output y. The measured output y„, 
corrupted by the measurement noise d„, is the input to the compensator 
F(s) whose output ye is subtracted from the reference (set point) y* to form 
the error signal e. 

The transfer functions Go{s), C{s), F(s) are generally proper and causal, 
and are allowed to be rational or irrational, which means they may include 
time delays. 

The feedback system can be described in a compact I/O matrix form by 
treating R = [y* , du, d, dn]'^ as the input vector, and E = [e,uo,y,yn]'^ and 
^ = [yo,ye,u]'^ as the output vectors, i.e.. 



E = H{s)R, Y = IiE + hR 



(3.6.1) 
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where 



H{s) 



1 



1 + FCGo 



1 

C 
CGq 
CGq 



-FGo 
1 

Go 
Go 



-F 
-FC 

1 

1 



-F 

-FC 

-FCGo 

1 



10 

-10 , /2 = 1 

10 



0-10 



-10 



3.6.2 Internal Stability 

Equation (3.6.1) relates all the signals in the system with the external inputs 
y* ,du,d,dn. From a practical viewpoint it is important to guarantee that 
for any bounded input vector R, all the signals at any point in the feedback 
system are bounded. This motivates the definition of the so-called internal 
stability [152, 231]. 

Definition 3.6.1 The feedback system is internally stable if for any bounded 
external input R, the signal vectors Y, E are bounded and in addition 



l^l|oo<Ci||i?| 



\E\ 



<C2\\R\ 



(3.6.2) 



for some constants ci,C2 > that are independent of R. 



A necessary and sufficient condition for the feedback system (3.6.1) to be 
internally stable is that each element of H{s) has stable poles, i.e., poles in 
the open left half s-plane [231]. 

The concept of internal stability may be confusing to some readers be- 
cause of the fact that in most undergraduate books the stability of the feed- 
back system is checked by examining the roots of the characteristic equation 

1 + FGGo = 

The following example is used to illustrate such confusions. 



Example 3.6.1 Consider 

Go(s) 



C{s) 



-, F{s) = 1 
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for which the characteristic equation 



1 + FCGn = 1 



(«■ 



(s + 5)(s-2) 



1 







(3.6.3) 



e 




s + 5 


-(s + 5)/(s-2) 


-(s + 5) 


-(s + 5) 


y* 


u„ 


1 


s-2 


s + 5 


-(s-2) 


-(s-2) 


du 


y 


s + 6 


1 


(s + 5)/(s-2) 


s + 5 


1 


d 


Vn 




1 


(s + 5)/(s-2) 


s + 5 


s + 5 


d„ 



has a single root at s = — 6, indicating stability. On the other hand, the transfer 
matrix H{s) calculated from this example yields 



(3.6.4) 



indicating that a bounded du will produce unbounded e,y,y„, i.e., the feedback 
system is not internally stable. We should note that in calculating (3.6.3) and 
(3.6.4), we assume that fx^g(s) and g{s) are the same transfer functions for any 
constant a. In (3.6.3) the exact cancellation of the pole at s = 2 of G(:){s) by 
the zero at s = 2 of C{s) led to the wrong stability result, whereas in (3.6.4) 
such cancellations have no effect on internal stability. This example indicates that 
internal stability is more complete than the usual stability derived from the roots 
of 1 + FCGq = 0. If, however, Go,C,F are expressed as the ratio of coprime 



polynomials, i.e., Go{s) 



i.o(s) 



C{s) 



cM 



F{s) 



"/(«) 



then a necessary and 



sufficient condition for internal stability [231] is that the roots of the characteristic 
equation 

PoPcPf + noncHf = (3.6.5) 

are in the open left-half s-plane. For the example under consideration, hq = l,po = 
s — 2, ric = s — 2,pc = s + 5,nf = l,pf = I we have 

(s - 2)(s + 5) + (s - 2) = (s - 2)(s + 6) = 
which has one unstable root indicating that the feedback is not internally stable. 

V 



3.6.3 Sensitivity and Complementary Sensitivity Functions 

Although internal stability guarantees that all signals in the feedback system 
are bounded for any bounded external inputs, performance requirements put 
restrictions on the size of some of the signal bounds. For example, one of the 
main objectives of a feedback controller is to keep the error between the plant 
output y and the reference signal y* small in the presence of external inputs, 
such as reference inputs, bounded disturbances, and noise. Let us consider 
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the case where in the feedback system of Figure 3.2, F(s) = l,du = 0. Using 
(3.6.1), we can derive the following relationships between the plant output 
y and external inputs y* , d, dn- 

y = Toy* + Sod - T^dn (3.6.6) 

where 

A 1 A CGo 

'-'0 — -, , ^^ ; Jo 



1 + CGo ' l + CGo 

are referred to as the sensitivity function and complementary sensitivity 
function, respectively. It follows that Sq^Tq satisfy 

5o + To = 1 (3.6.7) 

It is clear from (3.6.6) that for good tracking and output disturbance rejec- 
tion, the loop gain Lq = CGq has to be chosen large so that S'o ~ and 
To ~ 1. On the other hand, the suppression of the effect of the measure- 
ment noise dn on y requires Lq to be small so that Tq ~ 0, which from 
(3.6.7) implies that Sq ~ 1. This illustrates one of the basic trade-offs in 
feedback design, which is good reference tracking and disturbance rejection 
(|Lo| ^ 1,5*0 ~ 0, To ~ 1) has to be traded off against suppression of 
measurement noise (|iJo| *^ ^7 So ~ l,To ~ 0). In a wide class of control 
problems, y* , d are usually low frequency signals, and dn is dominant only at 
high frequencies. In this case, C{s) can be designed so that at low frequen- 
cies the loop gain Lq is large, i.e., 5*0 ~ 0, Tq ~ 1, and at high frequencies Lq 
is small, i.e., Sq « IjTq ~ 0. Another reason for requiring the loop gain Lq 
to be small at high frequencies is the presence of dynamic plant uncertainties 
whose effect is discussed in later chapters. 

3.6.4 Internal Model Principle 

In many control problems, the reference input or setpoint y* can be modeled 
as 

Qr{s)y* = (3.6.8) 

where Qr{s) is a known polynomial, and s = ^^ is the differential operator. 
For example, when y* =constant, Qris) = s. When y* = t, Qr{s) = s^ and 
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when y* = Asinuj^t for some constants A and ojq, then Qr{s) = s^ + oJq, etc. 
Similarly, a deterministic disturbance d can be modeled as 

Qd{s)d = {) (3.6.9) 

for some known Qd{s), in cases where sufficient information about d is avail- 
able. For example, if d is a sinusoidal signal with unknown amplitude and 
phase but with known frequency tOd then it can be modeled by (3.6.9) with 
Qd{s) = s^ + i^l 

The idea behind the internal model principle is that by including the 
factor n {s)o (s) ™ *^^ compensator C(s), we can null the effect of y*, t? on 
the tracking error e = y* — y. To see how this works, consider the feedback 
system in Figure 3.2 with F(s) = l,d„ = (i„ = and with the reference 
input y* and disturbance d satisfying (3.6.8) and (3.6.9) respectively for some 
known polynomials Qris), Qdis). Let us now replace C(s) in Figure 3.2 with 

^(^) = §4' ^(^) = Qris)Qdis) (3.6.10) 

Q{s) 

where C{s) in (3.6.10) is now chosen so that the poles of each element of 
H(s) in (3.6.1) with C(s) replaced by C{s) are stable. From (3.6.6) with 
du = dn = and C replaced by C/Q, we have 

Because Q = QrQd nulls d,y*, i.e., Q(s)d = 0,Q(s)y* = 0, it follows that 

which together with the stability of 1/{Q + CGq) guaranteed by the choice 
of C(s) imply that e(t) = y*{t) — y{t) tends to zero exponentially fast. 

The property of exact tracking guaranteed by the internal model principle 
can also be derived from the values of the sensitivity and complementary 
sensitivity functions Sq,Tq at the frequencies of y*,d. For example, if y* = 
sinwoi and d = sinwit, i.e., Q{s) = (s^ + Wo)(s^ + cjf) we have 

<? =—9— T ^^0 

° g + CGo' ° Q + CGo 
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and Soijujo) = So{juJi) = 0, To{juJo) = To{juJi) = 1. 

A special case of the internal model principle is integral control where 
Q{s) = s which is widely used in industrial control to null the effect of 
constant set points and disturbances on the tracking error. 



3.7 Problems 



3.1 (a) Sketch the unit disk defined by the set {x \x G 7^^, \x\p < 1 } for (i) 
p = I, (ii) p = 2, (iii) p = 3, and (iv) p = oo. 
(b) Calculate the C2 norm of the vector function 



x{t) 



le-'Ke-Y 



by (i) using the | • |2-norni in TZ^ and (ii) using the 



norm in TZ^. 



3.2 Let y = G{s)u and g{t) be the impulse response of G{s). Consider the induced 



norm of the operator T defined as ||r||oo 
-Coo 1-^ y e £00- Show that ||T||oo = ||a||i- 



sup 1 1 



where T : m G 



3.3 Take u{t) = f[t) where f{i), shown in the figure, is a sequence of pulses centered 
at n with width ^ and amplitude n, where n = l,2,...,oo. 



i 


^fW 




















1/ 


11 








1/8 

















■ 


1 

^ ^ 








1 






n 






1 




2 




3 


1 


f 



(a) Show that u £ Ci but u ^ Li and u >Coo- 

(b) If J/ = G{s)u where G{s) = —j and u = f, show that y E Cif] Coo and 

\y(t)\ ^ as t ^ 00. 



3.4 Consider the system depicted in the following figure: 
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Jfli^g^£i_ 



Hi 



yi 



y2 



H2 



62/ 



"2 



Let Hi,H2: Cc 



L. 



{H2e2)t\\ <72||e2t|| + 



satisfy 
||(ifiei)t||<7i||eit||+/3i 

;-"(*-^)7(T)||e2.||rfT + /32 



for all i > 0, where 71 > 0,72 > 0, a > 0, /3i,/32 are constants, ^{t) is a 
nonnegative continuous function and ||(-)t||i IKOII denote the CooeT^oo norm 
respectively. Let ||mi|| < c, ||u2|| < c for some constant c > 0, and 7172 < 1 
(small gain). Show that 



(a) If 7 e £2, then 61,62,^1,2/2 e >Coo. 

(b) If 7 e 5(/x), then 61,62,2/1,2/2 e £00 for any /i G [0,;U* 

""(1-7172)" 



where 



(3.7.1) 



2co7f 

3.5 Consider the system described by the following equation: 

X = A{t)x + f{t,x) + u 
where f{t,x) satisfies 

\f{t,x)\<-f{t)\x\ + Mt) 

for all X e 7^", t > and /(i, 0) = 0, where 7(t) > 0,7o(t) are continuous 
functions. If the equilibrium 2/e = of 2/ = A{t)y is u.a.s and 7 G S{fi), show 
that the following statements hold for some /i* > and any /i G [0,/i*): 

(a) w e £00 and 7o G sS(i^) for any i> > implies x G Coo 

(b) u = 0,7o = implies that the equilibrium Xe = of (3.7.1) is u.a.s in 

the large 

(c) u,7o G C2 implies that x G £00 and linit^^oo x{t) = 

(d) If u = 7o = then the solution x{t; to, xq) of (3.7.1) satisfies 

\x{t;to,xo)\ < Ke'^^'-*"^x{to)\ fort>ta>0 

where f3 = a—cofiK > for some constant cq and K,a > are constants 
in the bound for the state transition matrix <I>(t, t) of 2/ = A{t)y, i.e., 

||$(i,T)|| <K6-"(*-^), fort>T>to 
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3.6 Consider the LTI system 



X = {A+ eB)x 



where e > is a scalar. Calculate e* > such that for all e G [0,e*), the 
equilibrium state Xe = is e.s. in the large when 



(a) 
(b) 



A-- 



A 



-1 10 
-2 

10 
-1 



B 



B 



1 

2 5 

5 -8 
2 



using (i) the Euclidean norm and (ii) the infinity norm. 
3.7 Consider the system given by the following block diagram: 



^y^ 


ni 


^.\l^ _L M 


-w 


I 


1 


(j-(^^;i^j. -r ^v^;; 




















F{s) 

















where F{s) is designed such that the closed-loop system is internally stable 



when A(s) = 0, i.e., 



are stable transfer functions. Derive condi- 



l+FG' l+FG 

tions on G, F using the small gain theorem such that the mapping T : r i—> y 
is bounded in C2 for any A(s) that satisfies ||A(s)||oo < ^, where (5 > is a 
given constant. 



3.8 Consider the LTI system 



{A + B)x, xeW' 



where Re\i{A) < and B is an arbitrary constant matrix. Find a bound on 
||i3|| for Xg = to be e.s. in the large by 

(a) Using an appropriate Lyapunov function 

(b) Without the use of a Lyapunov function 

3.9 Examine the stability of the equilibrium states of the following differential 
equations: 

(a) X = sin t x 

(b) x={Msmt—t)x 
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(c) X = a{t)x, where a{t) is a continuous function with a{t) < \/t > to > 

3.10 Use Lyapunov's direct method to analyze the stabiUty of the following sys- 
tems: 

/ N { Xi = -Xi +X1X2 
\ X2 = -JX( 

(b) x+2x^ + 2x = 

1 -3 

2 -5 



X 



(c) x = 

xi = — 2a;i + a;ia;2 



(d) , 

' X2 = -XI - ax2 

3.11 Find the equilibrium state of the scalar differential equation 

x = -{x- l)(a;-2)2 
and examine their stability properties using 

(a) Linearization 

(b) Appropriate Lyapunov functions 

3.12 Consider the system described by 

Xi = X2 

X2 = —X2 — (ko + smt)xi 

where fco > is a constant. Use an appropriate Lyapunov function to inves- 
tigate stability of the equilibrium states. 

3.13 Check the PR and SPR properties of the systems given by the following 
transfer functions: 

(a) Gi{s) = (jipfy^f+jy 

(b) G2{s) = (j^ 

(c) G^is) = (5+fy(f+5y 

(d) G,{s) = ,,^1^^ 

3.14 Assume that the transfer function Gi{s) and G2(s) are PR. Check whether 
the following transfer functions are PR in general: 

(a) Ga{s) = Gi{s) + G2{s) 

(b) G„(s) = G,{s)G2{s) 

(c) Gf{s) = G^{s)[l + G2{s)]-^ 
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Repeat (a), (b), and (c) when Gi{s) and 62(5) are SPR. 
3.15 (a) Let 



Gi{s) 



s+1 



, L{s) 



s- 1 



Find a bound on e > for the transfer function 



G,{s) = Gi{s) + eL{s) 



to be PR, SPR. 
(b) Repeat (a) when 



Gi{s) 



s + 5 



{s + 2){s + 3)'' 
Comment on your results. 
3.16 Consider the following feedback system: 



L{s) 



s+1 




where a{s) = s^ — 3s + 2 and b{s) = s + a. Choose the constants ^0,^1,^2 
such that for a = 5, the transfer function 



y{s) 



Wm{s) 



1 



u{s) '""^ ' s+1 

What if a = —5? Explain. 

3.17 Consider the following system: 

e = Ae + Bcf) sin i, ei = C^ e 
(p = —ei smt 

where (/»,ei e7^^ee7^", (^, B) is controllable and lF„(s) = C^ {si - A)''^ B 
is SPR. Use Lemma 3.5.3 to find an appropriate Lyapunov function to study 
the stability properties of the system (i.e., of the equilibrium state (f)^ = 
0,ee = 0). 



^Find an e* > such that for all e £ [0, e*), Ge{s) is PR, SPR. 



Chapter 4 

On-Line Parameter 
Estimation 

4.1 Introduction 

In Chapter 2, we discussed various types of model representations and pa- 
ranieterizations that describe the behavior of a wide class of dynamic sys- 
tems. Given the structure of the model, the model response is determined 
by the values of certain constants referred to as plant or model parameters. 
In some applications these parameters may be measured or calculated using 
the laws of physics, properties of materials, etc. In many other applications, 
this is not possible, and the parameters have to be deduced by observing 
the system's response to certain inputs. If the parameters are fixed for all 
time, their determination is easier, especially when the system is linear and 
stable. In such a case, simple frequency or time domain techniques may 
be used to deduce the unknown parameters by processing the measured re- 
sponse data off-line. For this reason, these techniques are often referred to 
as off-line parameter estimation techniques. In many applications, the struc- 
ture of the model of the plant may be known, but its parameters may be 
unknown and changing with time because of changes in operating conditions, 
aging of equipment, etc., rendering off-line parameter estimation techniques 
ineffective. The appropriate estimation schemes to use in this case are the 
ones that provide frequent estimates of the parameters of the plant model 
by properly processing the plant I/O data on-line. We refer to these scheme 
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as on-line estimation schemes. 

The purpose of this chapter is to present the design and analysis of a 
wide class of schemes that can be used for on-line parameter estimation. The 
essential idea behind on-line estimation is the comparison of the observed 
system response y{t), with the output of a parameterized model y{9, t) whose 
structure is the same as that of the plant model. The parameter vector 6(t) 
is adjusted continuously so that y{6, t) approaches y(t) as t increases. Under 
certain input conditions, y{6, t) being close to y(t) implies that 6(t) is close to 
the unknown parameter vector 9* of the plant model. The on-line estimation 
procedure, therefore, involves three steps: In the first step, an appropriate 
parameterization of the plant model is selected. This is an important step 
because some plant models are more convenient than others. The second 
step 

generating or updating 6{t). The adaptive law is usually a differential 
equation whose state is 9{t) and is designed using stability considerations or 
simple optimization techniques to minimize the difference between y(t) and 
y(9, t) with respect to 9(t) at each time t. The third and final step is the 
design of the plant input so that the properties of the adaptive law imply 
that 9{t) approaches the unknown plant parameter vector 9* as t ^ oo. 
This step is more important in problems where the estimation of 9* is one of 
the objectives and is treated separately in Chapter 5. In adaptive control, 
where the convergence of 9(t) to 9* is usually not one of the objectives, 
the first two steps are the most important ones. In Chapters 6 and 7, a 
wide class of adaptive controllers are designed by combining the on-line 
estimation schemes of this chapter with appropriate control laws. Unlike 
the off-line estimation schemes, the on-line ones are designed to be used 
with either stable or unstable plants. This is important in adaptive control 
where stabilization of the unknown plant is one of the immediate objectives. 

The chapter is organized as follows: We begin with simple examples 
presented in Section 4.2, which we use to illustrate the basic ideas behind 
the design and analysis of adaptive laws for on-line parameter estimation. 
These examples involve plants that are stable and whose states are avail- 
able for measurement. In Section 4.3, we extend the results of Section 4.2 
to plants that may be unstable, and only part of the plant states is avail- 
able for measurement. We develop a wide class of adaptive laws using a 
Lyapunov design approach and simple optimization techniques based on the 
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gradient method and least squares. The on-hne estimation problem where 
the unknown parameters are constrained to lie inside known convex sets is 
discussed in Section 4.4. The estimation of parameters that appear in a spe- 
cial bilinear form is a problem that often appears in model reference adaptive 
control. It is treated in Section 4.5. In the adaptive laws of Sections 4.2 to 
4.5, the parameter estimates are generated continuously with time. In Sec- 
tion 4.6, we discuss a class of adaptive laws, referred to as hybrid adaptive 
laws, where the parameter estimates are generated at finite intervals of time. 
A summary of the adaptive laws developed is given in Section 4.7 where the 
main equations of the adaptive laws and their properties are organized in ta- 
bles. Section 4.8 contains most of the involved proofs dealing with parameter 
convergence. 

4.2 Simple Examples 

In this section, we use simple examples to illustrate the derivation and prop- 
erties of simple on-line parameter estimation schemes. The simplicity of 
these examples allows the reader to understand the design methodologies 
and stability issues in parameter estimation without having to deal with the 
more complex differential equations that arise in the general case. 

4.2.1 Scalar Example: One Unknown Parameter 

Let us consider the following plant described by the algebraic equation 

y{t) = 6*u{t) (4.2.1) 

where u G C^o is the scalar input, y(t) is the output, and 9* is an unknown 
scalar. Assuming that u{t),y{t) are measured, it is desired to obtain an 
estimate of 6* at each time t. If the measurements of y, u were noise free, 
one could simply calculate 9{t), the estimate of 6*, as 

e{t) = ^ (4.2.2) 

n(t) 

whenever n(t) / 0. The division in (4.2.2), however, may not be desirable 
because u{t) may assume values arbitrarily close to zero. Furthermore, the 
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effect of noise on the measurement of n, y may lead to an erroneous estimate 
of 9*. The noise and computational error effects in (4.2.2) may be reduced 
by using various other nonrecursive or off-line methods especially when 6* 
is a constant for all t. 

In our case, we are interested in a recursive or on-line method to generate 
9(t). We are looking for a differential equation, which depends on signals 
that are measured, whose solution is 9{t) and its equilibrium state is O^ = 0* . 
The procedure for developing such a differential equation is given below. 

Using 9(t) as the estimate of 9* at time t, we generate the estimated or 
predicted value y{t) of the output y(t) as 

m = 9it)uit) (4.2.3) 

The prediction or estimation error ei, which reflects the parameter uncer- 
tainty because 9(t) is different from 9*, is formed as the difference between 
y and y, i.e., 

ei = y-y = y-9u (4.2.4) 

The dependence of ei on the parameter estimation error 9 = 9 — 9* becomes 
obvious if we use (4.2.1) to substitute for y in (4.2.4), i.e., 

ei = 9*u -9u= -9u (4.2.5) 

The differential equation for generating 9{t) is now developed by minimizing 
various cost criteria of ei with respect to 9 using the gradient or Newton's 
method. Such criteria are discussed in great detail in Section 4.3. For this 
example, we concentrate on the simple cost criterion 

^ ' 2 2 

which we minimize with respect to 6. For each time t, the function J(9) is 
convex over TZ^; therefore, any local minimum of J is also global and satisfles 
VJ(0) = 0. One can solve VJ(^) = —(y — 9u)u = for 9 and obtain the 
nonrecursive scheme (4.2.2) or use the gradient method (see Appendix B) 
to form the recursive scheme 

9 = --iVJ{9) = -i{y - 9u)u = 'jem, 9{0) = Oq (4.2.6) 
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Figure 4.1 Implementation of the scalar adaptive law (4.2.6). 



where 7 > is a scaling constant, which we refer to as the adaptive gain. 
In the literature, the differential equation (4.2.6) is referred to as the update 
law or the adaptive law or the estimator, to name a few. In this book, we 
refer to (4.2.6) as the adaptive law for updating 6(t) or estimating 6* on-line. 
The implementation of the adaptive law (4.2.6) is shown in Figure 4.1. 
The stability properties of (4.2.6) are analyzed by rewriting (4.2.6) in terms 
of the parameter error 9 = 9 — 6*, i.e., 

9 = 9-9* = 7ein - 9* 

Because ei = 9*u — 9u = —9u and 9* is constant, i.e., 9* = 0, we have 

e = --iu^9, e{p) = 0(0) - 9* (4.2.7) 

We should emphasize that (4.2.7) is used only for analysis. It cannot be used 
to generate 9{t) because given an initial estimate 0(0) of 9* , the initial value 
0(0) = 0(0) — 9* , which is required for implementing (4.2.7) is unknown due 
to the unknown 0*. 

Let us analyze (4.2.7) by choosing the Lyapunov function 

The time derivative V oiV along the solution of (4.2.7) is given by 



V 



7 
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which after substitution of 6 from (4.2.7) becomes 

V = -uW = -e? < (4.2.8) 

which impHes that the equilibrium ^e = of (4.2.7) is u.s. 

Because no further information about u{€) is assumed other than u £ vCqo) 
we cannot guarantee that F < (e.g., take u{€) = 0) and, therefore, cannot 
estabhsh that ^e = is a.s. or e.s. We can, however, use the properties of 
V, V to estabhsh convergence for the estimation error and other signals in 
(4.2.6). For example, because F > is a nonincreasing function of time, the 
limf^oo V(8(t)) = T/qo exists. Therefore, from (4.2.8) we have 



ei{T)dT = - / V{T)dT = Vo-V^ 

Jo 

where Vq = V{9{0)), which implies that ei G £2- Now from (4.2.6) and 
u e Coo, we also have that 9 e vCoon^2- Because, as we have shown in 
Chapter 3, a square integrable function may not have a limit, let alone tend 
to zero with time, we cannot establish that ei(t), 6{t) ^ as t ^ 00 without 
additional conditions. If, however, we assume that u £ £00 then it follows 
that ei = —9u — Oil ^ Coo', therefore, from Lemma 3.2.5 we have ei(t) -^ 
as t ^ 00, which is implied by ei G £2) ei £ £00 • This, in turn, leads to 

lim §{t) = lim 0{t) = (4.2.9) 

t^oo t^oo 

The conclusion of this analysis is that for any u,u ^ Coo, the adaptive law 
(4.2.6) guarantees that the estimated output y(t) converges to the actual 
output y(t) and the speed of adaptation (i.e., the rate of change of the 
parameters 9) decreases with time and converges to zero asymptotically. 

One important question to ask at this stage is whether 9{t) converges as 
t ^ 00 and, if it does, is the lim^^oo 9(t) = 9*1 

A quick look at (4.2.9) may lead some readers to conclude that 9{t) -^ 
as ^ ^ 00 implies that 6(t) does converge to a constant. This conclusion is 
obviously false because the function 9{t) = sin(ln(2 + t)) satisfies (4.2.9) but 
has no limit. We have established, however, that V{9{t)) = y~ converges to 
T/qo as t ^ 00, i.e., linii^oo "(t) = 27^005 which implies that 9{t) and, there- 
fore, 9{t) does converge to a constant, i.e., limj^oo 9{t) = ± -\/27K» + 9* = 9. 
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Hence the question which still remains unanswered is whether 9 = 9*. It is 
clear from (4.2.1) that for u(t) = 0, a valid member of the class of input sig- 
nals considered, y(t) = Vt > 0, which provides absolutely no information 
about the unknown 9* . It is, therefore, obvious that without additional con- 
ditions on the input u(t),y(t) may not contain sufficient information about 
9* for the identification of 9* to be possible. 

For this simple example, we can derive explicit conditions on u{t) that 
guarantee parameter convergence by considering the closed-form solution of 
(4.2.7), i.e., 

0(t) = e-^/o«'W'^"^(O) (4.2.10) 

For inputs u{t) = or u(t) = e~*, 9(t) does not tend to zero, whereas for 
^^(^) = i+t) ^(0 tends to zero asymptotically but not exponentially. A 
necessary and sufficient condition for 9{t) to converge to zero exponentially 
fast is that n(t) satisfies 

rt+T„ 

/ u^(T)dT > aoTo (4.2.11) 

Vt > and for some aQ,TQ > (see Problem 4.1). It is clear that u(t) = 1 
satisfies (4.2.11), whereas u{t) = or e~* or j— ^ does not. The property of it 
given by (4.2.11) is referred to as persistent excitation (PE) and is crucial in 
many adaptive schemes where parameter convergence is one of the objectives. 
The signal u, which satisfies (4.2.11), is referred to be persistently exciting 
(PE). The PE property of signals is discussed in more detail in Section 4.3. 
It is clear from (4.2.10), (4.2.11) that the rate of exponential convergence 
of 9{t) to zero is proportional to the adaptive gain 7 and the constant ag 
in (4.2.11), referred to as the level of excitation. Increasing the value of 7 
will speed up the convergence of 9(t) to 9* . A large 7, however, may make 
the differential equation (4.2.6) "stiff" and, therefore, more difficult to solve 
numerically. 

The same methodology as above may be used for the identification of an 
n-dimensional vector 9* that satisfies the algebraic equation 

y = 9*^c^ (4.2.12) 

where y E TZ^, 4> G TZ^ are bounded signals available for measurement. We 
will deal with this general case in subsequent sections. 
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4.2.2 First-Order Example: Two Unknowns 

Consider the following first-order plant 

X = —ax + bu, x(0) = xq (4.2.13) 

where the parameters a and b are constant but unknown, and the input 
u and state x are available for measurement. We assume that a > and 
u e Coo so that X e Coo- The objective is to generate an adaptive law for 
estimating a and b on-line by using the observed signals u(t) and x{t). 

As in Section 4.2.1, the adaptive law for generating the estimates a and 
6 of a and b, respectively, is to be driven by the estimation error 

ei = x-x (4.2.14) 

where x is the estimated value of x formed by using the estimates a and b. 
The state x is usually generated by an equation that has the same form as 
the plant but with a and b replaced by d and 6, respectively. For example, 
considering the plant equation (4.2.13), we can generate x from 

X = —ax + bu, x(0) = xo (P) 

Equation (P) is known as the parallel model configuration [123] and the 
estimation method based on (P) as the output error method [123, 172]. The 
plant equation, however, may be rewritten in various different forms giving 
rise to different equations for generating x. For example, we can add and 
subtract the term UmX, where am > is an arbitrary design constant, in 
(4.2.13) and rewrite the plant equation as 

X = —amX + (am — o)x + bu 

i.e., 

[{am-a)x + bu] (4.2.15) 



s + am 
Furthermore, we can proceed and rewrite (4.2.15) as 

X = 9*^(p 

where 6* = \b, am — a]^, (t> = —, u, —, x\ , which is in the form of the 

algebraic equation considered in Section 4.2.1. Therefore, instead of using 
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(P), we may also generate x from 

X = —amX + {am — a)x + bu 

that is 

X = j^\{am - a)x + bu] (SP) 

by considering the parameterization of the plant given by (4.2.15). Equa- 
tion (SP) is widely used for parameter estimation and is known as the series- 
parallel model [123]. The estimation method based on (SP) is called the equa- 
tion error method [123, 172]. Various other models that are a combination of 
(P) and (SP) are generated [123] by considering different parameterizations 
for the plant (4.2.13). 

The estimation error ti = x — x satisfies the differential equation 



for model (P) and 
for model (SP) where 



ei = — aei + ax — bu (PI) 

ei = — amCi + ax — bu (SPl) 



a = a — a, b = b 



are the parameter errors. Equations (PI) and (SPl) indicate how the param- 
eter error affects the estimation error ei. Because a, am > 0, zero parameter 
error, i.e., a = b = 0, implies that ei converges to zero exponentially. Be- 
cause a, b are unknown, ei is the only measured signal that we can monitor 
in practice to check the success of estimation. We should emphasize, how- 
ever, that ei ^ does not imply that a,b ^ unless some PE properties 
are satisfied by x,x,u as we will demonstrate later on in this section. We 
should also note that ei cannot be generated from (PI) and (SPl) because 
a and b are unknown. Equations (PI) and (SPl) are, therefore, only used 
for the purpose of analysis. 

Let us now use the error equation (SPl) to derive the adaptive laws for 
estimating a and b. We assume that the adaptive laws are of the form 

a = fiiei,x,x,u), 6 = /2(ei,x,x,n) (4.2.16) 

where /i and /2 are functions of measured signals, and are to be chosen so 
that the equilibrium state 

Oe = a, be = b, tie = (4.2.17) 
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of the third-order differential equation described by (SPl) (where x G £00 
is treated as an independent function of time) and (4.2.16) is U.S., or, if 
possible, u.a.s., or, even better, e.s. 

We choose /i, /2 so that a certain function ^(ei, a, b) and its time deriva- 
tive V along the solution of (SPl), (4.2.16) are such that V qualifies as a Lya- 
punov function that satisfies some of the conditions given by Theorems 3.4.1 
to 3.4.4 in Chapter 3. We start by considering the quadratic function 

V{ei,~a,b) = ^{el + a^ + b^) (4.2.18) 

which is positive definite, decrescent, and radially unbounded in TZ"^. The 
time derivative of V along any trajectory of (SPl), (4.2.16) is given by 



V 



-am^l + axei - buei + afi + 6/2 (4.2.19) 



and is evaluated by using the identities a = a, b = b, which hold because a 
and b are assumed to be constant. 

If we choose /i = — eix, /2 = eiu, we have 

V = -am4 < (4.2.20) 

and (4.2.16) becomes 

a = -eix, b = eiu (4.2.21) 

where ei = x — x and x is generated by (SP). 

Applying Theorem 3.4.1 to (4.2.18) and (4.2.20), we conclude that V 
is a Lyapunov function for the system (SPl), (4.2.16) where x and u are 
treated as independent bounded functions of time and the equilibrium given 
by (4.2.17) is u.s. Furthermore, the trajectory ei(t) , a(t) , b(t) is bounded for 
all t > 0. Because ei = x — x and x £ £00 we also have that x £ £00; 
therefore, all signals in (SPl) and (4.2.21) are uniformly bounded. As in the 
example given in Section 4.2.1, (4.2.18) and (4.2.20) imply that 



and, therefore. 



lim V{ti{t),a{t),b{t)) = Foo < 00 

t— >oo 



00 1 roo 1 

el{T)dT = / VdT = —{Vo-Voo) 

O'm Jo Ojui 
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where Vq = y(ei(0), a(0), 6(0)), i.e., ei £ £2- Because u,a,b,x,ei e £00, it 
follows from (SPl) that ei G £00 which, together with ei ^ C2, implies that 
ei(t) ^ as t ^ 00, which, in turn, implies that a(t), b(t) ^ as t ^ cx). 

It is worth noting that ei(t), o(t), 5(i) ^ as t ^ cx) do not imply that 
a and b converge to any constant let alone to zero. As in the example of 
Section 4.2.1, we can use (4.2.18) and (4.2.20) and establish that 

lim(a2(t) + 62(t)) = 2Foo 

which again does not imply that a and b have a limit, e.g., take 

a(t) = ^/2Vo^ sin VTTt, b(t) = V2Foo cos Vl + t 

The failure to establish parameter convergence may motivate the reader 
to question the choice of the Lyapunov function given by (4.2.18) and of the 
functions /i,/2 in (4.2.19). The reader may argue that perhaps for some 
other choices of V and /i,/2, u.a.s could be established for the equilibrium 
(4.2.17) that will automatically imply that a,6^0ast^oo. Since given 
a differential equation, there is no procedure for finding the appropriate 
Lyapunov function to establish stability in general, this argument appears 
to be quite valid. We can counteract this argument, however, by applying 
simple intuition to the plant equation (4.2.13). In our analysis, we put no 
restriction on the input signal n, apart from u £ £00 and no assumption is 
made about the initial state xq. For u = 0, an allowable input in our analysis, 
and xq = 0, no information can be extracted about the unknown parameters 
a, b from the measurements of x(t) = 0, n(t) = 0, Vt > 0. Therefore, no 
matter how intelligent an adaptive law is, parameter error convergence to 
zero cannot be achieved when ti = Vt > 0. This simplistic explanation 
demonstrates that additional conditions have to be imposed on the input 
signal u to establish parameter error convergence to zero. Therefore, no 
matter what V and /i,/2 we choose, we can not establish u.a.s. without 
imposing conditions on the input u. These conditions are similar to those 
imposed on the input n in Section 4.2.1, and will be discussed and analyzed 
in Chapter 5. 

In the adaptive law (4.2.21), the adaptive gains are set equal to 1. A 
similar adaptive law with arbitrary adaptive gains 71 , 72 > is derived by 
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considering 

V{ei,a,b) = -[el + - + -] 
2 V 71 72/ 

instead of (4.2.18). Following the same procedure as before we obtain 

a = -7ieix, b = 'j2^iu 

where 71, 72 > are chosen appropriately to slow down or speed up adapta- 
tion. 

Using (4.2.18) with model (PI) and following the same analysis as with 
model (SPl), we obtain 

h=-eix, b = eiu (4.2.22) 

and 

V = -at\ < 

Hence, the same conclusions as with (4.2.21) are drawn for (4.2.22). 

We should note that V for (PI) depends on the unknown a, whereas for 
(SPl) it depends on the known design scalar Um. Another crucial difference 
between model (P) and (SP) is their performance in the presence of noise, 
which becomes clear after rewriting the adaptive law for a in (4.2.21), (4.2.22) 
as 

a = — (x — x)x = Sp' — XX (P) 

a = — (x — x)x = — x^ + XX (SP) 

If the measured plant state x is corrupted by some noise signal v, i.e., x is 
replaced by x + v in the adaptive law, it is clear that for the model (SP), 
a will depend on v"^ and w, whereas for model (P) only on v. The effect of 
noise (v"^) may result in biased estimates in the case of model (SP), whereas 
the quality of estimation will be less affected in the case of model (P). The 
difference between the two models led some researchers to the development 
of more complicated models that combine the good noise properties of the 
parallel model (P) with the design flexibility of the series-parallel model (SP) 
[47, 123]. 
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Simulations 

We simulate the parallel and series-parallel estimators and examine the ef- 
fects of the input signal n, the adaptive gain and noise disturbance on their 
performance. For simplicity, we consider a first-order example y = -^r^u 
with two unknown parameters a and b. Two adaptive estimators 

a = — eix, b = eiu 

X = —ax + bu, ti = X — X 

and 

a = —eix, b = eiu 

X = —CLmX + (cm — o)x + 6n, ei = X — X 

based on the parallel and series-parallel model, respectively, are simulated 
with a = 2 and fc = 1. The results are given in Figures 4.2 and Figure 4.3, 
respectively. Plots (a) and (b) in Figure 4.2 and 4.3 give the time response 
of the estimated parameters when the input u = sinSt, and the adaptive 
gain 7=1 for (a) and 7 = 5 for (b). Plots (c) in both figures give the results 
of estimation for a step input, where persistent excitation and, therefore, 
parameter convergence are not guaranteed. Plots (d) show the performance 
of the estimator when the measurement x{t) is corrupted by d{t) = O.ln(t), 
where n{t) is a normally distributed white noise. 

It is clear from Figures 4.2 (a,b) and Figure 4.3 (a,b) that the use of a 
larger value of the adaptive gain 7 led to a faster convergence of a and b 
to their true values. The lack of parameter convergence to the true values 
in Figure 4.2 (c), 4.3 (c) is due to the use of a non-PE input signal. As 
expected, the parameter estimates are more biased in the case of the series- 
parallel estimator shown in Figure 4.3 (d) than those of the parallel one 
shown in Figure 4.2 (d). 

4.2.3 Vector Case 

Let us extend the example of Section 4.2.2 to the higher-order case where 
the plant is described by the vector differential equation 

X = ApX + BpU (4.2.23) 



Figure 4.2 Simulation results of the parallel estimator, (a) u = sin5t, 7 = 1, no 
measurement noise; (b) u = sin5t,7 = 5, no measurement noise; (c) u =unit 
step function, 7 = 1, no measurement noise; (d) u = sin5t,7 = 1, output x is 
corrupted by d{i) = O.ln(t), where nit) is a normally distributed white noise. 



where the state x G TZ"" and input u e TV are available for measurement, 
Ap e TV^'^,Bp e 7^"X'" are unknown, Ap is stable, and u e Coo- As in the 
scalar case, we form the parallel model 

£ = ApX + BpU, xeTV (P) 

where Ap(t), Bp{t) are the estimates of Ap, Bp at time t to be generated by 



Figure 4.3 Simulation results of the series-parallel estimator, (a) u = sinSt, 
7 = 1, no measurement noise; (b) u = sin5t,7 = 5, no measurement noise; 
(c) u =unit step function, 7 = 1, no measurement noise; (d) u = sin5t,7 = 1, 
output X is corrupted by d{t) = O.ln(i), where n(t) is the normally distributed 
white noise. 

an adaptive law, and x(t) is the estimate of the vector x(t). Similarly, by 
considering the plant parameterization 

where A^ is an arbitrary stable matrix, we define the series-parallel model 
as 

X = AmX + {Ap - Am)x + BpU (SP) 
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The estimation error vector ei defined as 

A 
ei = X — X 

satisfies 

ei = Apti — ApX — BpU (PI) 

for model (P) and 

ei = Amei - ApX - BpU (SPl) 

for model (SP), where Ap = Ap — Ap, Bp = Bp — Bp. 

Let us consider the parallel model design and use (PI) to derive the 
adaptive law for estimating the elements of Ap,Bp. We assume that the 
adaptive law has the general structure 

Ap = Fi{ei,x,x,u), Bp = F2{ei,x,x,u) (4.2.24) 

where Fi and F2 are functions of known signals that are to be chosen so that 
the equilibrium 

-^pe — ^pj -Ope — -'^pi ^le — " 

of (PI), (4.2.24) has some desired stability properties. We start by consid- 
ering the function 



fAlPAp\^fBlPBp 

71 / V 72 



V{e,,Ap,Bp) = el Pei + tr I ^^^^^ ) + tr ( -J^-^ | (4.2.25) 



where ti{A) denotes the trace of a matrix A, 71, 72 > are constant scalars, 
and P = P > is chosen as the solution of the Lyapunov equation 

PAp + AJp = -I (4.2.26) 

whose existence is guaranteed by the stability of Ap (see Theorem 3.4.10). 
The time derivative VofV along the trajectory of (PI), (4.2.24) is given by 

V = iJPei + eJPei 



ApPAp AjPAp] ^^ I BpPBp BjPBp ^ 



+tr -^ + 



71 71 



72 72 



/ 
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which after substituting for ei,Ap,Bp becomes 

-r -r T ~ T ~ / AlPFi BJPF2\ 
V = eJiPAp + ^^P)ei - 2eJ PApX - 2eJ PBpU + tr 2^ + 2^ 

\ 71 '12 J 

(4.2.27) 
We use the following properties of trace to manipulate (4.2.27): 

(i) tr(AB) = tr(BA) 

(ii) tr(A + B)= tr{A) + tr{B) for any A,B e TT'^'' 

(iii) tr(yx^) = x^ y for any x,y ^ TZ"-^^ 

We have 

tJPApX = x^iJPei = tr(iJPei£^) 

eJPBpU = tr(^JPeiu^) 
and, therefore, 

V = -eje, + 2tr ( ^ll^ _ A^ Pe^^-^ + ^^^^ - BJ Pe^uA (4.2.28) 

V 71 72 ^ y 

The obvious choice for Fi , F2 to make V negative is 

Ap = Fi = jieix'^ , hp = F2 = -i2eiu^ (4.2.29) 

In the case of the series-parallel model, we choose 



.p, ^pj - e^Pei + ti [ - I I +^ I 

V 71 / V 72 



V{euAp, Bp) = ei Pei + tr ( ^^-^ ) + tr ( ^^-^ ) (4.2.30) 

where P = P~^ > is the solution of the Lyapunov equation 

A'iP + PAm = -I (4.2.31) 

By following the same procedure as in the case of the parallel model, we 
obtain 

Ap = jieix'^, Bp = -i2tiu^ (4.2.32) 
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Remark 4.2.1 If instead of (4.2.30), we choose 

Viei,Ap,Bp) = ej Pei + tr [AJ Ap) + tr [bJ Bp) (4.2.33) 

where P = P~^ > satisfies (4.2.31), we obtain 

Ap = Peix^, Bp = Peiu^ (4.2.34) 

In this case P is the adaptive gain matrix and is calculated using 
(4.2.31). Because Am is a known stable matrix, the calculation of P 
is possible. It should be noted that if we use the same procedure for 
the parallel model, we will end up with an adaptive law that depends 
on P that satisfies the Lyapunov equation (4.2.26) for Ap. Because 
Ap is unknown, P cannot be calculated; therefore, the adaptive laws 
corresponding to (4.2.34) for the parallel model are not implementable. 

The time derivative 1/ of F in both the parallel and series-parallel esti- 
mators satisfies 

V = -ejti < 

which implies that the equilibrium Ape = Ap, Bpe = Bp,eie = of the respec- 
tive equations is u.s. Using arguments similar to those used in Section 4.2.2 
we establish that ei e £2, ei G ^00 and that 

|ei(t)|^0, ||ip(t)||^0, \\Bp{t)\\^0 as t^ 00 

The convergence properties of Ap, Bp to their true values Ap,Bp, respectively, 
depend on the properties of the input u. As we will discuss in Chapter 5, if u 
belongs to the class of sufficiently rich inputs, i.e., u has enough frequencies 
to excite all the modes of the plant, then the vector [a; , u ] is PE and 
guarantees that Ap,Bp converge to Ap,Bp, respectively, exponentially fast. 

4.2.4 Remarks 

(i) In this section we consider the design of on-line parameter estimators 
for simple plants that are stable, whose states are accessible for mea- 
surement and whose input u is bounded. Because no feedback is used 
and the plant is not disturbed by any signal other than u, the stability 
of the plant is not an issue. The main concern, therefore, is the stability 
properties of the estimator or adaptive law that generates the on-line 
estimates for the unknown plant parameters. 
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(ii) For the examples considered, we are able to design on-line parameter es- 
timation schemes that guarantee that the estimation error ei converges 
to zero as t ^ oo, i.e., the predicted state x approaches that of the plant 
as t ^ oo and the estimated parameters change more and more slowly 
as time increases. This result, however, is not sufficient to establish 
parameter convergence to the true parameter values unless the input 
signal u is sufficiently rich. To be sufficiently rich, u has to have enough 
frequencies to excite all the modes of the plant. 

(iii) The properties of the adaptive schemes developed in this section rely 

on the stability of the plant and the boundedness of the plant input u. 
Consequently, they may not be appropriate for use in connection with 
control problems where u is the result of feedback and is, therefore, no 
longer guaranteed to be bounded a priori . In the following sections, we 
develop on-line parameter estimation schemes that do not rely on the 
stability of the plant and the boundedness of the plant input. 



4.3 Adaptive Laws with Normalization 

In Section 4.2, we used several simple examples to illustrate the design of 
various adaptive laws under the assumption that the full state of the plant 
is available for measurement, the plant is stable, and the plant input is 
bounded. In this section, we develop adaptive laws that do not require the 
plant to be stable or the plant input to be bounded a priori. Such adaptive 
laws are essential in adaptive control, to be considered in later chapters, 
where the stability of the plant and the boundedness of the plant input are 
properties to be proven and, therefore, cannot be assumed to hold a priori. 
We begin with simple examples of plants whose inputs and states are not 
restricted to be bounded and develop adaptive laws using various approaches. 
These results are then generalized to a wider class of higher-order plants 
whose output rather than the full state vector is available for measurement. 



4.3.1 Scalar Example 

Let us consider the simple plant given by the algebraic equation 

y{t) = e*u{t) (4.3.1) 
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where u and, therefore, y are piecewise continuous signals but not necessarily 
bounded, and 6* is to be estimated by using the measurements of y and u. 
As in Section 4.2.1, we can generate the estimate y of y and the estimation 
error ei as 

y = 9u 

^i = y-y = y-du 

where 9(t) is the estimate of 9* at time t. 

Because u and y are not guaranteed to be bounded, the minimization 
problem 

mm J(ti) = mm 

e ^ ' e 2 

is ill posed and, therefore, the procedure of Section 4.2.1 where u,y ^ Coo 
does not extend to the case where u,y ^ Coo- This obstacle is avoided by 
dividing each side of (4.3.1) with some function referred to as the normalizing 
signal m > to obtain 

y = 9*u (4.3.2) 



where 



y - u 

y = —, u= — 

m m 



are the normalized values of y and u, respectively, and m? = 1 + n^. The 
signal Hs is chosen so that — £ £oo- A straightforward choice for n^ is 
Hs = u, i.e., m^ = 1 + n^. 

Because u,y (z Coo, we can follow the procedure of Section 4.2.1 and 
develop an adaptive law based on (4.3.2) rather than on (4.3.1) as follows: 

The estimated value y of y is generated as 

y = 9u 
and the estimation error as 

^i = y-y = y-0u 

It is clear that ei = — = ^~ " and y = y/m. The adaptive law for 9 is now 
developed by solving the well-posed minimization problem 

mm J(t/j = mm = mm 



2m^ 
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Using the gradient method we obtain 

= ^eiu, 7 > (4.3.3) 

or in terms of the unnormahzed signals 

e = 7^ (4.3.4) 

where m may be chosen as m^ = 1 + n^. 

For clarity of presentation, we rewrite (4.3.3) and (4.3.4) as 

e = -feu (4.3.5) 

where 

ei 

We refer to e as the normalized estimation error. This notation enables us 
to unify results based on different approaches and is adopted throughout the 
book. 

Let us now analyze (4.3.5) by rewriting it in terms of the parameter error 
e = e-e*. using ^ = ^ and e = ei/m^ = -^ = -g, we have 

= -^u^0 (4.3.6) 

We propose the Lyapunov function 

whose time derivative along the solution of (4.3.6) is given by 

V = -0^1? = -t^rn^ < 

Hence, 0, ^ e £00 and era £ £2- Because 0,u ^ Coo, it follows from e = —9i^ 
that e,em £ Coo- If we now rewrite (4.3.5) as 9 = 'jemu, it follows from 
em e £00 n ^2 and u e £00 that 9 e £000-^2- Since ^em = —9u — 9u 
and 9,9,u e £00, it follows that for n e £00 we have -^{em) e £00, which, 
together with em e £2, implies that em ^ as t ^ 00. This, in turn, 
implies that ^ as t ^ 00. 
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The significance of this example is that even in the case of unbounded y, u 
we are able to develop an adaptive law that guarantees bounded parameter 
estimates and a speed of adaptation that is bounded in an £2 and £00 sense 

When Us = 0, i.e., m = 1 the adaptive law (4.3.5) becomes the unnor- 
malized one considered in Section 4.2. It is obvious that for m = 1, in 
(4.3.5), i.e., e = ei, we can still establish parameter boundedness, but we 
can not guarantee boundedness for 9 in an Cp sense unless u £ £00 • As 
we will demonstrate in Chapter 6, the property that ^ £ £2 is crucial for 
stability when adaptive laws of the form (4.3.5) are used with control laws 
based on the certainty equivalence principle to stabilize unknown plants. 

4.3.2 First-Order Example 

Let us now consider the same plant (4.2.15) given in Section 4.2.2, i.e., 

X = [{am — a)x + u] (4.3.7) 

where for simplicity we assume that 6 = 1 is known, u is piecewise continuous 
but not necessarily bounded, and a may be positive or negative. Unlike the 
example in Section 4.2.2, we make no assumptions about the boundedness of 
X and u. Our objective is to develop an adaptive law for estimating a on-line 
using the measurements of x, u. If we adopt the approach of the example in 
Section 4.2.2, we will have 

X = [{am — a)x + n], ei = x — x (4.3.8) 

s + am 

and 

'a=-tix. (4.3.9) 

Let us now analyze (4.3.8) and (4.3.9) without using any assumption about 
the boundedness of x,u. We consider the estimation error equation 

ei = —am^i + ax (4.3.10) 

where a = a — a and propose the same function 

^=| + y (4.3.11) 
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as in Section 4.2.2. The time derivative of V along (4.3.9) and (4.3.10) is 
given by 

V = -am4 < (4.3.12) 

Because x is not necessarily bounded, it cannot be treated as an independent 
bounded function of time in (4.3.10) and, therefore, (4.3.10) cannot be de- 
coupled from (4.3.8). Consequently, (4.3.8) to (4.3.10) have to be considered 
and analyzed together in TZ"^, the space of ei,a,x. The chosen function V 
in (4.3.11) is only positive semidefinite in 7?,^, which implies that V is not a 
Lyapunov function; therefore. Theorems 3.4.1 to 3.4.4 cannot be applied. V 
is, therefore, a Lyapunov-like function, and the properties of V, V allow us 
to draw some conclusions about the behavior of the solution ei(t), a(t) with- 
out having to apply the Lyapunov Theorems 3.4.1 to 3.4.4. From V > and 
V = —o-m^i < we conclude that V £ Coo, which implies that ei,a G Coo, 
and ei G £2- Without assuming x £ £00 however, we cannot establish any 
bound for a in an Cp sense. 

As in Section 4.3.1, let us attempt to use normalization and modify 
(4.3.9) to achieve bounded speed of adaptation in some sense. The use of 
normalization is not straightforward in this case because of the dynamics 
introduced by the transfer function , i.e., dividing each side of (4.3.7) 

by m may not help because 



X 1 



X u 

[am -a) h 



m m 



m s + a^ 
For this case, we propose the error signal 

1 1 

e = X — X enl = [ax — en^) (4.3.13) 

•S I Ojm S -p Clrn 

i.e., 

e = —Qm^ + dx — eUg 

where Ug is a normalizing signal to be designed. 

Let us now use the error equation (4.3.13) to develop an adaptive law for 
a. We consider the Lyapunov-like function 

^ = y + y (4.3.14) 
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whose time derivative along the solution of (4.3.13) is given by 

V = — a^e — e rig + aex + aa 

Choosing 

a = a = —ex (4.3.15) 

we have 

V = -a^e^ - e^nl < 

which together with (4.3.14) imply V,e,a e Coo and e, en^ G £2- If we now 
write (4.3.15) as 

X 

a = —em — 
m 

where m^ = 1 + n^ and choose Us so that ^ £ £00, then em £ C2 (because 
e, eug e £2) implies that a G £2- A straightforward choice for Ug is tt-s = x, 
i.e., m? = 1 + x"^ . 

The effect of Ug can be roughly seen by rewriting (4.3.13) as 

e = —Qm^ — eUg + ax (4.3.16) 

and solving for the "quasi" steady-state response 

'"'' (4.3.17) 



am + nl 



obtained by setting e ~ in (4.3.16) and solving for e. Obviously, for 
n1 = x^, large e^ implies large a independent of the boundedness of x, which, 
in turn, implies that large e^ carries information about the parameter error 
a even when x £00 • This indicates that Ug may be used to normalize the 
effect of the possible unbounded signal x and is, therefore, referred to as 
the normalizing signal. Because of the similarity of e^ with the normalized 
estimation error defined in (4.3.5), we refer to e in (4.3.13), (4.3.16) as the 
normalized estimation error too. 

Remark 4.3.1 The normalizing term en^ in (4.3.16) is similar to the non- 
linear "damping" term used in the control of nonlinear systems [99]. 
It makes V more negative by introducing the negative term — e^n^ in 
the expression for V and helps establish that erig e £2- Because a is 
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Figure 4.4 Effect of normalization on the convergence and performance of 
the adaptive law (4.3.15). 

bounded from above by e^/n^ + 1 = em and em £ C2, we can con- 
clude that a (z C2, which is a desired property of the adaptive law. 
Note, however, that a e £2 does not imply that d £ £00 • In contrast 
to the example in Section 4.3.1, we have not been able to establish 
that d e £00 • As we will show in Chapter 6 and 7, the £2 property 
of the derivative of the estimated parameters is sufficient to establish 
stability in the adaptive control case. 



Simulations 

Let us simulate the effect of normalization on the convergence and perfor- 
mance of the adaptive law (4.3.15) when a = is unknown, u = sint, and 
a-in = 2. We use n^ = ax'^ and consider different values of a > 0. The 
simulation results are shown in Figure 4.4. It is clear that large values of a 
lead to a large normalizing signal that slows down the speed of convergence. 
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4.3.3 General Plant 

Let us now consider the SISO plant 

x = Ax + Bu, x(0) = xo //iQicN 

y = C^x ^^■^■^^> 

where x £ 7?." and only y, u are available for measurement. Equation (4.3.18) 
may also be written as 

y = C^{sl - A)-^Bu + C^{sl - A)-^xo 

or as 

H[s) K[s) 

where Z(s),R(s) are in the form 

Z{s) = 6„-is""^ + 6„-2s""^ + --- + bis + bo 

R(s) = s" + an-is"-'^ H h ais + ao 

The constants Oj, 6j for i = 0, l,...,n — 1 are the plant parameters. A 
convenient parameterization of the plant that allows us to extend the results 
of the previous sections to this general case is the one where the unknown 
parameters are separated from signals and expressed in the form of a linear 
equation. Several such parameterizations have already been explored and 
presented in Chapter 2. We summarize them here and refer to Chapter 2 
for the details of their derivation. 
Let 

0* = [b-n-l, bn-2, ■ ■ ■ ,bi,bo, an-1, a„_2, . . . , Oi, Oo] 

be the vector with the unknown plant parameters. The vector 6* is of di- 
mension 2n. If some of the coefficients of Z(s) are zero and known, i.e., 
Z(s) is of degree m < n — 1 where m is known, the dimension of 6* may be 
reduced. Following the results of Chapter 2, the plant (4.3.19) may take any 
one of the following parameterizations: 

z = e*^(P + rjo (4.3.20) 

y = ei'c^ + r]o (4.3.21) 
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where 



z = Wi{s)y, (t> = H{s) 



*T„ 



y = W{s)ei'i, + ilo 



u 

y 



^ = Hi{s) 



u 

y 



Vo 



(4.3.22) 



4e^^^BoXo 



Wi(s),H(s),Hi(s) are some known proper transfer function matrices with 
stable poles, 6a = [0, A"'"]"'' is a known vector, and Ac is a stable matrix which 
makes r]o to be an exponentially decaying to zero term that is due to non- 
zero initial conditions. The transfer function W{s) is a known strictly proper 
transfer function with relative degree 1, stable poles, and stable zeros. 

Instead of dealing with each parametric model separately, we consider 
the general model 

z = W{s)e*^tp + r]o (4.3.23) 



where W{s) is a proper transfer function with stable poles, z £ 'R-^,^ G "7^^" 
are signal vectors avails 
we will assume that -qo 



are signal vectors available for measurement and r]o = cj e ''^Bqxo- Initially 



0, i.e. 



z = w{s)e*'ip 



(4.3.24) 



and use (4.3.24) to develop adaptive laws for estimating 9* on-line. The effect 
of 770 and, therefore, of the initial conditions will be treated in Section 4.3.7. 

Because 9* is a constant vector, going from form (4.3.23) to form (4.3.20) 
is trivial, i.e., rewrite (4.3.23) as z = 9*'^ W {s)tp + r]o and define (p = W{s)'tp. 
As illustrated in Chapter 2, the parametric model (4.3.24) may also be a 
parameterization of plants other than the LTI one given by (4.3.18). What 
is crucial about (4.3.24) is that the unknown vector 9* appears linearly in 
an equation where all other signals and parameters are known exactly. For 
this reason we will refer to (4.3.24) as the linear parametric model. In the 
literature, (3.4.24) has also been referred to as the linear regression model. 

In the following section we use different techniques to develop adaptive 
laws for estimating 9* on-line by assuming that W(s) is a known, proper 
transfer function with stable poles, and Zjip are available for measurement. 
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4.3.4 SPR-Lyapunov Design Approach 

This approach dominated the literature of continuous adaptive schemes [48, 
149, 150, 153, 172, 178, 187]. It involves the development of a differential 
equation that relates the estimation or normalized estimation error with 
the parameter error through an SPR transfer function. Once in this form 
the KYP or the MKY Lemma is used to choose an appropriate Lyapunov 
function V whose time derivative V is made nonpositive, i.e., F < by 
properly choosing the differential equation of the adaptive law. 

The development of such an error SPR equation had been a challeng- 
ing problem in the early days of adaptive control [48, 150, 153, 178]. The 
efforts in those days were concentrated on finding the appropriate transfor- 
mation or generating the appropriate signals that allow the expression of the 
estimation/parameter error equation in the desired form. 

In this section we use the SPR-Lyapunov design approach to design adap- 
tive laws for estimating 9* in the parametric model (4.3.24). The connection 
of the parametric model (4.3.24) with the adaptive control problem is dis- 
cussed in later chapters. By treating parameter estimation independently 
of the control design, we manage to separate the complexity of the estima- 
tion part from that of the control part. We believe this approach simplifies 
the design and analysis of adaptive control schemes, to be discussed in later 
chapters, and helps clarify some of the earlier approaches that appear tricky 
and complicated to the nonspecialist. 

Let us start with the linear parametric model 

z = W{s)e*^tP (4.3.25) 

Because 9* is a constant vector, we can rewrite (4.3.25) in the form 

z = W{s)L{s)9*^(f> (4.3.26) 

where 

cP=L-\s)^ 

and I/(s) is chosen so that L~^(s) is a proper stable transfer function and 
W(s)L(s) is a proper SPR transfer function. 

Remark 4.3.2 For some W(s) it is possible that no L(s) exists such that 
W(s)L(s) is proper and SPR. In such cases, (4.3.25) could be prop- 
erly manipulated and put in the form of (4.3.26). For example, when 
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W{s) = j^, no L{s) can be found to make W{s)L{s) SPR. In this 
case, we write (4.3.25) as z = jjt^vtjt^O*'^ (j) where 4> = jrji^ and 
z = -^z. The new W{s) in this case is W{s) = / , ^w^.g-, and a wide 



{s+2){s+3)' 

i case is M' 
class of L(s) can be found so that WL is SPR. 



The significance of the SPR property of W(s)L(s) is explained as we 
proceed with the design of the adaptive law. 

Let 9(t) be the estimate of 6* at time t. Then the estimate z of z at time 
t is constructed as 

z = W{s)L{s)e'^(p (4.3.27) 

As with the examples in the previous section, the estimation error ei is 
generated as 

€l = Z — Z 

and the normalized estimation error as 

e= z- z- W{s)L{s)en'i = ei - Wis)L{s)en1 (4.3.28) 

where rig is the normalizing signal which we design to satisfy 

- e/:oo, m'^ = l + n1 (Al) 

m 

Typical choices for Ug that satisfy (Al) are n^ = (f^cpju'^ = (p^ P(p for 
any P = P~^ > 0, etc. When (p £ >Coo, (Al) is satisfied with m = 1, i.e., 
n^ = in which case e = ei. 

We examine the properties of e by expressing (4.3.28) in terms of the 
parameter error 9 = 6 — 9*, i.e., substituting for z, z in (4.3.28) we obtain 

e=WL{-9'^(j)-tn'i) (4.3.29) 

For simplicity, let us assume that L(s) is chosen so that WL is strictly proper 
and consider the following state space representation of (4.3.29): 



e = Ace + Bc{-9'^(j) - tnl) 
t = Cje 



y (4.3.30) 



where Ac, Be, and Cc are the matrices associated with a state space repre- 
sentation that has a transfer function W{s)L{s) = Cj {si — Ac)~^Bc. 
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The error equation (4.3.30) relates e with the parameter error 9 and is 
used to construct an appropriate Lyapunov type function for designing the 
adaptive law of 9. Before we proceed with such a design, let us examine 
(4.3.30) more closely by introducing the following remark. 

Remark 4.3.3 The normahzed estimation error e and the parameters Ac, 
Be, and Cc in (4.3.30) can be calculated from (4.3.28) and the knowl- 
edge of WL, respectively. However, the state error e cannot be mea- 
sured or generated because of the unknown input 9'^ (p. 

Let us now consider the following Lyapunov-like function for the differ- 
ential equation (4.3.30): 

me)^q^ + ^ («.31, 

where T = T > is a constant matrix and Pc = Pj > satisfies the 
algebraic equations 

PcAe + AjPc = -qq^ - vL^ , . 

for some vector q, matrix Lc = LJ > and a small constant v > 0. Equation 
(4.3.32) is guaranteed by the SPR property of W{s)L{s) = Cj {si - Ac)~^Bc 
and the KYL Lemma if (Ac,Bc,Cc) is minimal or the MKY Lemma if 
(Ac, Be, Cc) is nonminimal. 

Remark 4.3.4 Because the signal vector (p in (4.3.30) is arbitrary and could 
easily be the state of another differential equation, the function (4.3.31) 
is not guaranteed to be positive definite in a space that includes (p. 
Hence, F is a Lyapunov-like function. 

The time derivative V along the solution of (4.3.30) is given by 
V{9, e) = -^e^qq'^e - ^e^ LcC + e^ PcBc[-¥ (j) - en^] + FV'^i) (4.3.33) 

We now need to choose ^ = ^ as a function of signals that can be measured 
so that the indefinite terms in V are canceled out. Because e is not available 
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for nieasurenient, 9 cannot depend on e explicitly. Therefore, at first glance, 
it seems that the indefinite term —ePcBcOcj) = —OcpePcBc cannot be 
cancelled because the choice 9 = 9 = Tcpe^ PcBc is not acceptable due to the 
presence of the unknown signal e. 

Here, however, is where the SPR property of WL becomes handy. We 
know from (4.3.32) that PcBc = Cc which implies that e^ P^Bc = e^ Cc = e. 
Therefore, (4.3.33) can be written as 

V(0^ e) = --e^qq^e - -e^L^e - e¥ cj) - e^nl + ^^p-^e (4.3.34) 

The choice for 9 = 9 to make F < is now obvious, i.e., for 

9 = 9 = re(p (4.3.35) 

we have 

V(e^ e) = --e^qq'^e - ^e^ L^e - e^nl < (4.3.36) 

which together with (4.3.31) implies that F, e, e,9,9 e Coo and that 

lim V{9{t),e{t)) = T4o <oo 

Furthermore, it follows from (4.3.36) that 

r t'^nldr +'^ r e^Lcedr < F(^(0), e(0)) - Foo (4.3.37) 

Jo 2 Jo 

Because Xmin{Lc)\e\'^ < e LcC and V{9{0), e(0)) is finite for any finite initial 
condition, (4.3.37) implies that ens,e £ £2 and therefore e = Cje G £2- 
Prom the adaptive law (4.3.35), we have 

1^1 < ||r|||em|^ 
m 

where m,^ = 1 + n^. Since e^m^ = e^ + e^n^ and e, en^ £ £2 we have that 
em e £2, which together with ^ e £00 implies that 9 = 9 ^ £2- 

We summarize the properties of (4.3.35) by the following theorem. 

Theorem 4.3.1 The adaptive law (4-3.35) guarantees that 
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Figure 4.5 Block diagram for implementing adaptive algorithm (4.3.35) 
with normalized estimation error. 

(i) ^,ee£oo 
(ii) t,tns,d ^ C2 

independent of the boundedness properties of (p. 



Remark 4.3.5 Conditions (i) and (ii) of Theorem 4.3.1 specify the quality 
of estimation guaranteed by the adaptive law (4.3.35). In Chapters 6 
and 7, we will combine (4.3.35) with appropriate control laws to form 
adaptive control schemes. The stability properties of these schemes 
depend on the properties (i) and (ii) of the adaptive law. 



Remark 4.3.6 The adaptive law (4.3.35) using the normalized estimation 
error generated by (4.3.28) can be implemented using the block di- 
agram shown in Figure 4.5. When W(s)L(s) = 1, the normalized 
estimation error becomes e = ei/(l + n^) with ei = z — z, which is the 
same normalization used in the gradient algorithm. This result can be 
obtained using simple block diagram transformation, as illustrated in 
Figure 4.6. 

Remark 4.3.7 The normalizing effect of the signal n^ can be explained 
by setting e = in (4.3.30) and solving for the "quasi" steady-state 
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nt 



1 



1 + nl 



Figure 4.6 Two equivalent block diagrams for generating the normalized 
estimation error when W{s)L{s) = 1. 



response tss of e, i.e. 



ei^ 



a{-e'^(p) _ 
1 + aril 1 + anl 



(4.3.38) 



where a = —Cj A~^Bc is positive, i.e., a > 0, because of the SPR 
property of WL and eiss is the "quasi" steady state response of ei. 
Because of Ug, ess cannot become unbounded as a result of a possibly 
unbounded signal (p. Large tss implies that 9 is large; therefore, large 
e carries information about 9, which is less affected by (p. 



Remark 4.3.8 The normalizing signal Us may be chosen as n^ = (p (p ^^ 
as n^ = (p P{t)(p where P{t) = P (t) > has continuous bounded 
elements. In general, if we set ris = we cannot establish that 9 €z C2 
which, as we show in later chapters, is a crucial property for estab- 
lishing stability in the adaptive control case. In some special cases, we 
can afford to set n^ = and still establish that ^ G £2- For example, 
if e £00 or if ^, e e £00 implies that (p G £00, then it follows from 
(4.3.35) that e e £2 ^ ^ e £2- 

When n^ = 0, i.e., m = 1, we refer to (4.3.35) as the unnormalized 
adaptive law. In this case e = ei leading to the type of adaptive 
laws considered in Section 4.2. In later chapters, we show how to use 
both the normalized and unnormalized adaptive laws in the design of 
adaptive control schemes. 



Another desired property of the adaptive law (4.3.35) is the convergence 
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of 9(t) to the unknown vector 9*. Such a property is achieved for a special 
class of vector signals (p described by the following definition: 

Definition 4.3.1 (Persistence of Excitation (PE)) A piecewise contin- 
uous signal vector (p : TZ'^ >-^ 7^" is PE in TZ^ with a level of excitation 
aQ > if there exist constants ai, Tq > such that 

ail>— (f)iT)(f^ iT)dT > aol, Vt > (4.3.39) 

To Jt 

Although the matrix (P{t)(J) (t) is singular for each r, (4.3.39) requires that 
(p{t) varies in such a way with time that the integral of the matrix 4>{t)4> (t) 
is uniformly positive definite over any time interval [t,t + Tq]. 
If we express (4.3.39) in the scalar form, i.e., 

ai>T^ {q^4>{r)?dT > ao, Vt > (4.3.40) 

Jo Jt 

where q is any constant vector in 7?-" with \q\ = 1, then the condition can 
be interpreted as a condition on the energy of (j) in all directions. The 
properties of PE signals as well as various other equivalent definitions and 
interpretations are given in the literature [1, 12, 22, 24, 52, 75, 127, 141, 171, 
172, 201, 242]. 

Corollary 4.3.1 //ns, </>,(/) £ £oo o-nd (p is PE, then (4.3.35) guarantees 
that 6{t) —> 9* exponentially fast. 

The proof of Corollary 4.3.1 is long and is given in Section 4.8. 

Corollary 4.3.1 is important in the case where parameter convergence is 
one of the primary objectives of the adaptive system. We use Corollary 4.3.1 
in Chapter 5 to establish parameter convergence in parameter identifiers and 
adaptive observers for stable plants. 

The condition that (p appears only in the case of the adaptive laws based 
on the SPR-Lyapunov approach with W{s)L(s) strictly proper. It is a con- 
dition in Lemma 4.8.3 (iii) that is used in the proof of Corollary 4.3.1 in 
Section 4.8. 

The results of Theorem 4.3.1 are also valid when W(s)L(s) is biproper 
(see Problem 4.4). In fact if W{s) is minimum phase, one may choose L(s) = 
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W-'^{s) leading to W{s)L{s) = 1. For WL = 1, (4.3.28), (4.3.29) become 

z-z e'^6 



m? 



where m? = 1 + n^ . In this case we do not need to employ the K YP or MK Y 
Lemma because the Lyapunov-like function 

leads to 

V = -t^rr? 

by choosing 

9 = Ve(j) (4.3.41) 

The same adaptive law as (4.3.41) can be developed by using the gradient 
method to minimize a certain cost function of e with respect to 9. We discuss 
this method in the next section. 

Example 4.3.1 Let us consider the following signal 

y = Asm{Ljt + Lp) 

that is broadcasted with a known frequency uj but an unknown phase Lp and un- 
known amplitude A. The signal y is observed through a device with transfer function 
W{s) that is designed to attenuate any possible noise present in the measurements 
of y, i.e., 

z = W{s)y = W{s)As\rL{ujt + ip) (4.3.42) 

For simplicity let us assume that W{s) is an SPR transfer function. Our objective 
is to use the knowledge of the frequency to and the measurements of z to estimate 
A,ip. Because A, ip may assume different constant values at different times we would 
like to use the results of this section and generate an on-line estimation scheme that 
provides continuous estimates for A, ip. The first step in our approach is to transform 
(4.3.42) in the form of the linear parametric model (4.3.24). This is done by using 
the identity 

A sm[ujt -\- ip) = Ai sin tot -\- A2 cos cot 

where 

Ai = Acosip, A2 = Asmip (4.3.43) 

to express (4.3.42) in the form 
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where 6* = [^1,^2]^ and <p = [sin iut, cos ivt]^ . 

From the estimate of 9*, i.e., Ai,A2, we can calculate the estimate of A,ip by 
using the relationship (4.3.43). Using the results of this section the estimate 0(t) of 
9* at each time t is given by 

9 = Te4> 



z — z ■ 



VF(s)en2, z = W{s)9'^(t>, n^ = a(f)^ <P 

where 9 = [^1,^2]^ and Ai,A2 is the estimate of Ai,A2, respectively. Since 
4> G £00, the normalizing signal may be taken to be equal to zero, i.e., a = 0. The 
adaptive gain T may be chosen as F = diag{"f) for some 7 > 0, leading to 



Ai=jesmujt, A2 = je cos Lot 



(4.3.44) 



The above adaptive law guarantees that Ai,A2,e G C^o and e,Ai,A2 G £2- Since 
(j) G Coo we also have that Ai,A2 G Cqo- As we mentioned earlier the convergence 
of Ai, A2 to Ai, A2 respectively is guaranteed provided (p is PE- We check the PE 
property of (j) by using (4.3.39). We have 



1 



t+To 



Jo 



where 



S{t,To 
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For Tf 
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To sin 2Lu{t + Tg) — sin 2ajt 

~2 4^ 

cos 2uj{t + To) — cos 2ujt 

we have 



cos 2u}{t + To) — cos 2cjt 

4tj 
To sin 2uj{t + To) — sin 2u!t 



1 
T~oJt 



t+Ta 



(r)(?i^(T)dT 



7T 

ijj 


" 





TT 



Hence, the PE condition (4.3.39) is satisfied with To = 2it/uj, < ao < i'/'^, c^i > 
— ; therefore, (j) is PE, which implies that Ai,A2 converge to Ai,A2 exponentially 
fast. 

Using (4.3.43), the estimate A, ip of A, (p, respectively, is calculated as follows: 



A{t) 



Al{t)+Al{t), p 



Mt) 
. Mt) , 



(4.3.45) 



The calculation of (p at each time t is possible provided A{t) ^ 0. This implies 
that Ai, A2 should not go through zero at the same time, which is something that 
cannot be guaranteed by the adaptive law (4.3.44). We know, however, that Ai,A2 
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converge to Ai,A2 exponentially fast, and Ai,A2 cannot be both equal to zero 
(otherwise y = Vi > 0). Hence, after some finite time T, Ai,A2 will be close 
enough to Ai,A2 for A{T) / to imply A{t) ^0\/t>T. 

Because Ai, A2 — > Ai,A2 exponentially fast, it follows from (4.3.45) that A, (^ 
converge to A, ip exponentially fast. 

Let us simulate the above estimation scheme when M^(s) = j^, uj = 2 rad/sec 

and the unknown A, ip are taken as A = 10, if = 16° = 0.279 rad for < i < 20 sec 

and A = 7,ip = 25° = 0.463 rad for i > 20 sec for simulation purposes. The results 

are shown in Figure 4.7, where 7 = 1 is used. \7 



Example 4.3.2 Consider the following plant: 

hs + bo 



y 



3s- 



where 61, 69 are the only unknown parameters to be estimated. We rewrite the plant 
in the form of the parametric model (4.3.24) by first expressing it as 

y=- ^, -e*^i: (4.3.46) 

" (s + l)(s + 2) ^ ^ ' 

where 6*= [bi, bo]^, ■ip=[u,u]^ . We then choose L(s) = s + 2 so that W{s)L{s) = ^^ 
is SPR and rewrite (4.3.46) as 

y = -^()*^^ (4.3.47) 

s + 1 

where <p = jr^w, jqij^ can be generated by filtering u. Because (4.3.47) is in 

the form of parametric model (4.3.24), we can apply the results of this section to 
obtain the adaptive law 

1 



y 



9 (p + en1), Hs = a(j) 4> 



s+l 

where a > and = [61, 69]^ is the on-line estimate of 9* . This example illustrates 
that the dimensionality of 9,(f) may be reduced if some of the plant parameters are 
known. V 



4.3.5 Gradient Method 

Some of the earlier approaches to adaptive control in the early 1960s [20, 34, 
96, 104, 115, 123, 175, 220] involved the use of simple optimization techniques 



A (t) sin (2t+ 9 (t) ) 
A sin (2t + (p) 



Figure 4.7 Simulation results for Example 4.3.1. 



such as the gradient or steepest descent method to minimize a certain perfor- 
mance cost with respect to some adjustable parameters. These approaches 
led to the development of a wide class of adaptive algorithms that had found 
wide applications in industry. Despite their success in applications, the 
schemes of the 1960s lost their popularity because of the lack of stability in 
a global sense. As a result, starting from the late 1960s and early 1970s, 
the schemes of the 1960s have been replaced by new schemes that are based 
on Lyapunov theory. The gradient method, however, as a tool for designing 
adaptive laws retained its popularity and has been widely used in discrete- 
time [73] and, to a less extent, continuous-time adaptive systems. In contrast 
to the schemes of the 1960s, the schemes of the 1970s and 1980s that are 
based on gradient methods are shown to have global stability properties. 
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What made the difference with the newer schemes were new formulations of 
the parameter estimation problem and the selection of different cost func- 
tions for minimization. 

In this section, we use the gradient method and two different cost func- 
tions to develop adaptive laws for estimating 9* in the parametric model 

z = W{s)9*^^ (4.3.24) 

The use of the gradient method involves the development of an algebraic 
estimation error equation that motivates the selection of an appropriate cost 
function J (6) that is convex over the space of 9{t), the estimate of 9* at time 
t, for each time t. The function J{9) is then minimized with respect to 9 
for each time t by using the gradient method described in Appendix B. The 
algebraic error equation is developed as follows: 

Because 9* is constant, the parametric model (4.3.24) can be written in 
the form 

z = 9*^(p (4.3.48) 

where (p = W(s)tp. 

The parametric model (4.3.48) has been the most popular one in discrete 
time adaptive control. At each time t, (4.3.48) is an algebraic equation where 
the unknown 9* appears linearly. Because of the simplicity of (4.3.48), a wide 
class of recursive adaptive laws may be developed. 

Using (4.3.48) the estimate z of z at time t is generated as 



where 9(t) is the estimate of 9* at time t. The normalized estimation error 
e is then constructed as 

z — z z — 9^ 6 
e = ^ = ^ 4.3.49 

where m? = 1 + n^ and Ug is the normalizing signal designed so that 

- e £00 (Al) 

m 
As in Section 4.3.4, typical choices for n^ are n^ = (p^ (f), n1 = (f^ P(f) for 
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For analysis purposes we express e as a function of the parameter error 
6 = 6 — 9*, i.e., substituting for z in (4.3.49) we obtain 

e= ^ (4.3.50) 

Clearly the signal em = —6— is a reasonable measure of the parameter 
error 6 because for any piecewise continuous signal vector cj) (not necessarily 
bounded), large em implies large 6. Several adaptive laws for 6 can be 
generated by using the gradient method to minimize a wide class of cost 
functions of e with respect lo 6. In this section we concentrate on two 
different cost functions that attracted considerable interest in the adaptive 
control community. 

Instantaneous Cost Function 

Let us consider the simple quadratic cost function 

motivated from (4.3.49), (4.3.50), that we like to minimize with respect to 
6. Because of the property (Al) of m, J{d) is convex over the space of 6 
at each time t; therefore, the minimization problem is well posed. Applying 
the gradient method, the minimizing trajectory d{t) is generated by the 
differential equation 

6 = -VVJ{6) 

where V = T^ > is a scaling matrix that we refer to as the adaptive gain. 
From (4.3.51) we have 

m^ 
and, therefore, the adaptive law for generating 6(t) is given by 

6 = Te(j) (4.3.52) 

We refer to (4.3.52) as the gradient algorithm. 
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Remark 4.3.9 The adaptive law (4.3.52) has the same form as (4.3.35) 
developed using the Lyapunov design approach. As shown in Section 
4.3.4, (4.3.52) follows directly from the Lyapunov design method by 
taking L(s) = W-'^(s). 

Remark 4.3.10 The convexity of J(6) (as explained in Appendix B) guar- 
antees the existence of a single global minimum defined by V J(0) = 0. 
Solving VJ(e) = -t(p = -^^^(^ = 0, i.e., (pz = (fxf^e, for 6 will give 
us the nonrecursive gradient algorithm 

e{t) = (#^)-V^ 

provided that (jjcf)^ is nonsingular. For (p G 7?,"^^ and n > 1, (fxf)^ is 
always singular, the following nonrecursive algorithm based on A^ data 
points could be used: 



e{t) 



f N \~'^N 

Y,<t){ti)(f^{u)\ 5]0(t,)z(i,) 



where tj < i, i = 1, . . . ,N are the points in time where the measure- 
ments of (f) and z are taken. 

Remark 4.3.11 The minimum of J (9) corresponds to e = 0, which implies 
^ = and the end of adaptation. The proof that 6(t) will converge 
to a trajectory that corresponds to e being small in some sense is 
not directly guaranteed by the gradient method. A Lyapunov type 
of analysis is used to establish such a result as shown in the proof of 
Theorem 4.3.2 that follows. 



Theorem 4.3.2 The adaptive law (4-3.52) guarantees that 

(i) e,ens,6,6 e Coo 
(ii) e,ens,6eC2 

independent of the boundedness of the signal vector (p and 

(iii) if rig, (p £ £oo o-nd (p is PE, then 0{t) converges exponentially to 6* 
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(4.3.53) 



Proof Because 9* is constant, 9 = 9 and from 


(4 


.3.52) 


we 


have 


'9: 


= Te<i) 










We choose the Lyapunov-like function 












V{9) -- 


Fv- 


^9 








2 






Then along the solution of (4.3.53), we 


have 










V = F<he 




< 







(4.3.54) 

where the second equality is obtained by substituting 0^ (f) = —em? from (4.3.50). 
Hence, V,6 €i Coo, which, together with (4.3.50), implies that e,em G Coc- In 
addition, we establish from the properties of V, V , by applying the same argument 
as in the previous sections, that em G C2, which implies that e, eUg G £2- Now from 
(4.3.53) we have 

|^V|^|<||r|||em|M (4.3.55) 

m 

which together with — G Coo and em G £2 H '^oo implies that ^ G £2 H '^oo and 
the proof for (i) and (ii) is complete. 

The proof for (iii) is long and more complicated and is given in Section 4.8. □ 



Remark 4.3.12 The property V(6) > and F < of the Lyapunov-like 
function implies that linit^oo ^(^(i)) = Voo- This, however, does not 
imply that V(t) goes to zero as i ^ 00. Consequently, we cannot con- 
clude that e or em go to zero as t ^ 00, i.e., that the steepest descent 
reaches the global minimum that corresponds to VJ(0) = —ecp = 0. 
If however, ^/m,rn/m G £00, we can establish that -^{tm) e £00, 
which, together with em £ C2, implies that e{t)m{t) ^ as t ^ 00. 
Because m? = 1 + n^ we have e(i) ^ as t ^ 00 and from (4.3.55) 
that e{t) ^ as t ^ 00. Now \VJ{e)\ < \e(f>\ < |em|^, which implies 
that |VJ(0(t))| ^ as t ^ 00, i.e., 6(t) converges to a trajectory that 
corresponds to a global minimum of ,J(9) asymptotically with time 

provided ^,^e £00. 

Remark 4.3.13 Even though the form of the gradient algorithm (4.3.52) 
is the same as that of the adaptive law (4.3.35) based on the SPR- 
Lyapunov design approach, their properties are different. For example. 
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(4.3.52) guarantees that 6 £ Coo, whereas such property has not been 
shown for (4.3.35). 

The speed of convergence of the estimated parameters to their true values, 
when ns,(f) (z Coo and cp is PE, is characterized in the proof of Theorem 4.3.2 
(iii) in Section 4.8. It is shown that 

F(t)r-i^(t) < 7"F(o)r-^^(o) 

where < t < nTo, n is an integer and 

2aoToAmm(r) 



7 = 1 - 71, 71 



2mo + f3^TiXl,,iT) 



where oq is the level of excitation of (p, Tq > is the size of the time interval 
in the PE definition of (p, mo = supf^Q ■m?(t) and /3 = supj>Q |(/>(t)|. We 
established that < 7 < 1. The smaller the 7, i.e., the larger the 71, the 
faster the parameter error converges to zero. The constants aQ,To,(3 and 
possibly niQ are all interdependent because they all depend on (f){t). It is, 
therefore, not very clear how to choose (f){t), if we can, to increase the size 
of 71. 

Integral Cost Function 

A cost function that attracted some interest in the literature of adaptive 
systems [108] is the integral cost function 

J{e) = l [\-f^^*-^h^{t,T)n?{T)dT (4.3.56) 

2 Jo 

where /3 > is a design constant and 

<t,r) = <^^-'l^'^^^^\ eit,t) = e (4.3.57) 

is the normalized estimation error at time r based on the estimate 6(t) of 6* 
at time t > t. The design constant (3 acts as a forgetting factor, i.e., as time 
t increases the effect of the old data at time r < t is discarded exponentially. 
The parameter 6(t) is to be chosen at each time t to minimize the integral 
square of the error on all past data that are discounted exponentially. 
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Using (4.3.57), we express (4.3.56) in terms of the parameter 9, i.e., 

2 Jo m''{T) 

Clearly, J(6) is convex over the space of 9 for each time t and the application 
of the gradient method for minimizing J(9) w.r.t. 9 yields 

9 = -TV J = r /%-/^(--)Ml)^4;(Ml))^(,),, (4.3.59) 

Jo m^[T) 

where T = T^ > is a scaling matrix that we refer to as the adaptive gain. 
Equation (4.3.59) is implemented as 

9 = -r(i?(t)0 + Q(t)) 

R = _/3i^+r^, i?(o =0 

Q = -f3Q-^, Q(0) = (4.3.60) 

where R £ 71"^", Q e 7^"'<^ We refer to (4.3.59) or (4.3.60) as the integral 
adaptive law. Its form is different from that of the previous adaptive laws 
we developed. The properties of (4.3.60) are also different and are given by 
the following theorem. 



Theorem 4.3.3 The integral adaptive law (4-3.60) guarantees that 

(i) e,ens,9,9 e Coo 

(ii) e,ens,9eC2 

(iii) limt_oo|^(t)|=0 

(iv) if ns,4> £ -Coo o-nd <p is PE then 9{t) converges exponentially to 9*. 
Furthermore, for F = 7/ the rate of convergence can be made arbitrarily 
large by increasing the value of the adaptive gain 7. 

Proof Because ^ G £001 it follows that R,Q (£ C^o and, therefore, the differential 
equation for 6 behaves as a linear time- varying differential equation with a bounded 
input. Substituting for z = <p^ 9* in the differential equation for Q we verify that 

Q{t) = - f e"^(*--) ^ill^lMd^r = -R{t)e* (4.3.61) 

Jo "^ 
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and, therefore, 

9 = e=-TR{t)e (4.3.62) 

We analyze (4.3.62) by using the Lyapunov-like function 

V{0) = -^ (4.3.63) 

whose time derivative along the solution of (4.3.62) is given by 

V = -e'^R{t)e (4.3.64) 

Because R{t) = i?^(i) > Vt > it follows that V < 0; therefore, ¥,6,9 e C^o, 

[0^ R9)^ = \R2d\ G £2- From e = $ and 9,— (£ Coo we conclude that e,€Tn 

and, therefore, eUg G C^c- 
From (4.3.62) we have 

\9\<\\TRt\\\rH\ (4.3.65) 

which together with R G C^c and |i?2 0| G C^c f] ^2 imply that 9 G £00 H ^2- Since 
9,R £ Coo, it follows from (4.3.62) that 9 G £001 which, together with 9 G C2, 
implies limt_,oo \e{t)\ = limj^oo \TR{t)9{t)\ = 0. 

To show that em G £2 we proceed as follows. We have 

—Fr9 = t^m^ - 2¥ RVR9 - Q¥ R9 

dt ' 

Therefore, 

t __/"*_ _ /"* _ 



e'-m^dT = 9' R9 + 2 9' RTR9dT + [3 9' R9dT 
-'0 Jo 

Because \\mt^ oo[d'^ {t)R{t)9{t)] = and \R^9\ G £2 it follows that 

f't f'OQ 

lim / e m dr = I e m dr < 00 



t—^00 J Q 



i.e., em G £2- 

Hence, the proof for (i) to (iii) is complete. The proof for (iv) is given in Section 

4.8. a 



Remark 4.3.14 In contrast to the adaptive law based on the instantaneous 
cost, the integral adaptive law guarantees that 6(t) = — TV J(^(t)) -^ 
as t ^ 00 without any additional conditions on the signal vector cj) 
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and m. In this case, 9(t) converges to a trajectory that minimizes 
the integral cost asymptotically with time. As we demonstrated in 
Chapter 3 using simple examples, the convergence of 9{t) to a zero 
vector does not imply that 0{t) converges to a constant vector. 

In the proof of Theorem 4.3.3 (iv) given in Section 4.8, we have estab- 
Ushed that when n^, £ Coo and (p is PE, the parameter error 9 satisfies 



where 



\m\ < \i^^\OiTo)\e=^^'-^"\ Vt > To 



a = 2/3ie ^'^°XminiT), Pi = aoToag, Oq = sup „, , 



and ttQ) Tq are constants in the definition of the PE property of (p, i.e., ao > 
is the level of excitation and Tg > is the length of the time interval. The 
size of the constant a > indicates the speed with which \9{t)\ is guaranteed 
to converge to zero. The larger the level of excitation oq, the larger the a is. 
A large normalizing signal decreases the value of a and may have a negative 
effect on the speed of convergence. If T is chosen as P = 7/, then it becomes 
clear that a larger 7 guarantees a faster convergence of \9(t)\ to zero. 

Example 4.3.3 Let us consider the same problem as in Example 4.3.1. We consider 
the equation 

z = W{s)Asm{ujt + ip) = W{s)9*'^(j) (4.3.66) 

where 0* = [Ai, ^2]^, (f> = [sin ujt, cos ivt]^ , Ai = A cos ip, A2 = A sin ip. We need to 
estimate A, tp using the knowledge of 0,a;, W{s) and the measurement of z. 

We first express (4.3.66) in the form of the linear parametric model (4.3.48) by 
filtering with W{s), i.e., 

z = 0*^cj)o, ^0 = W{s)p (4.3.67) 

and then obtain the adaptive law for estimating 6* by applying the results of this 
section. The gradient algorithm based on the instantaneous cost is given by 

^ = re(/.o, e= ^, -m? = I + a(t)l (t>Q (4.3.68) 

where 9 = [^1,^2]^ is the estimate of 9* and a > 0. Because (f) G C^o and W{s) 
has stable poles, cpo G £00 and a can be taken to be equal to zero. 



A 
A 



A (t) sin (2f + 9 (t) ) 
A sin (It + (p) 



Figure 4.8 Simulation results for Example 4.3.3: Performance of the gradient 
adaptive law (4.3.68) based on the instantaneous cost. 

The gradient algorithm based on the integral cost is given by 
e = -T{R{t)e+Q), 9{0) = 9o 
R = -pR+'M^^ i?(0) = (4.3.69) 

Q = -/30-^, Q(0) = 

where R G Ti?^^,Q G Ti?^^ . The estimate A,if oi the unknown constants A^ip is 
calculated from the estimates Ai,A2 in the same way as in Example 4.3.1. We can 
establish, as shown in Example 4.3.1, that (po satisfies the PE conditions; therefore, 
both adaptive laws (4.3.68) and (4.3.69) guarantee that 6 converges to 6* exponen- 
tially fast. 

Let us now simulate (4.3.68) and (4.3.69). We choose F = diag{"f) with 7 = 10 
for both algorithms, and /3 = 0.1 for (4.3.69). We also use to = 2 rad/sec and 



A 
A 



A (t) sin (2f + 9 (t) ) 
A sin (It + (p) 



Figure 4.9 Simulation results for Example 4.3.3: Performance of the gra- 
dient adaptive law (4.3.69) based on the integral cost. 

VF(s) = -Tjj- Figure 4.8 shows the performance of the adaptive law (4.3.68) based 
on the instantaneous cost, and Figure 4.9 shows that of (4.3.69) based on the integral 
cost. V 



Remark 4.3.15 This example illustrates that for the same estimation prob- 
lem the gradient method leads to adaptive laws that require more 
integrators than those required by adaptive laws based on the SPR- 
Lyapunov design approach. Furthermore, the gradient algorithm based 
on the integral cost is far more complicated than that based on the 
instantaneous cost. This complexity is traded off by the better conver- 
gence properties of the integral algorithm described in Theorem 4.3.3. 
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4.3.6 Least-Squares 

The least-squares is an old method dating back to Gauss in the eighteenth 
century where he used it to determine the orbit of planets. The basic idea 
behind the least-squares is fitting a mathematical model to a sequence of 
observed data by minimizing the sum of the squares of the difference between 
the observed and computed data. In doing so, any noise or inaccuracies in 
the observed data are expected to have less effect on the accuracy of the 
mathematical model. 

The method of least-squares has been widely used in parameter esti- 
mation both in a recursive and nonrecursive form mainly for discrete-time 
systems [15, 52, 73, 80, 127, 144]. The method is simple to apply and analyze 
in the case where the unknown parameters appear in a linear form, such as 
in the linear parametric model 



3*T , 



(4.3.70) 



Before embarking on the use of least-squares to estimate 9* in (4.3.70), let 
us illustrate its use and properties by considering the simple scalar plant 

y = e*u + dn (4.3.71) 

where dn is a noise disturbance; y,u ^ TZ'^ and u G Coo- We examine 
the following estimation problem: Given the measurements of y^r), u{t) for 
< T < t, find a "good" estimate 9{t) of 6* at time t. One possible solution 
is to calculate 6{t) from 

e{t) = ^ = r + ^"(") 



u{t) u{t) 

for some t < t for which u{t) / 0. Because of the noise disturbance, 
however, such an estimate may be far off from 9* . A more natural approach 
is to generate 9 by minimizing the cost function 

J{0) = \ j\y{r) - 9{t)u{T)fdT (4.3.72) 

with respect to 9 at any given time t. The cost J{9) penalizes all the past 
errors from r = to t that are due to 9{t) / 9* . Because J {9) is a convex 
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function over 7Z^ at each time t, its niininiuni satisfies 

V J(^) = - / y{T)u{T)dT + e{t) I u^{T)dT = (4.3.73) 

for any given time i, wliich gives 

9{t) = ( f u^{T)dT) f y{T)u{T)dT (4.3.74) 

provided of course the inverse exists. This is the celebrated least-squares 
estimate. The least-squares method considers all past data in an effort to 
provide a good estimate for 6* in the presence of noise dn. For example, 
when u(t) = 1 Vt > and d„ has a zero average value, we have 

lim e{t) = lim - / y{T)u{T)dT = 6* + Yim - f dn{T)dT = 9* 

t^oo t^oo t Jo t^oo t Jo 

i.e., 9(t) converges to the exact parameter value despite the presence of the 
noise disturbance dn. 

Let us now extend this problem to the linear model (4.3.70). As in 
Section 4.3.5, the estimate z of z and the normalized estimation error are 
generated as 

z = 9'^cP, e='-^ = '-^^ (4.3.49) 

where m^ = 1 + n^, 9{t) is the estimate of 9* at time t, and m satisfies 
(j)/m e Coo- 

We consider the following cost function 



2 Jo m^(r) 2 

(4.3.75) 
where Qo = Qq > 0, /3 > 0, 9o = d{0), which is a generalization of (4.3.72) 
to include discounting of past data and a penalty on the initial estimate 9o 
of 9*. The cost (4.3.75), apart from the additional term that penalizes the 
initial parameter error, is identical to the integral cost (4.3.58) considered 
in Section 4.3.5. The method, however, for developing the estimate 9(t) for 
9* is different. Because z/m, cp/m G Ccx), J{G) is a convex function of 9 over 
TV^ at each time t. Hence, any local minimum is also global and satisfies 

VJ{9{t)) = 0, Vt > 
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I.e., 



vj{e) 



-fit( 



_,^ z{r)-e^{t)<P{r) 



Jo m'^iT) 

which yields the so-called nonrecursive least-squares algorithm 



9(1) = Pit) 



-pt( 



'0 



^ P(t-r) z{t)<P{t) 



m^{i 



dr 



where 



P(t) 



-m 



JO 



m?{T) 



dr 



(4.3.76) 



(4.3.77) 



Because Qq = Qq > and (fxf^ is positive semidefinite, P{t) exists at each 
time t. Using the identity 

lpp-i = pp-i + plp-i = 

dt dt 

we can show that P satisfies the differential equation 



P = (3P- P^P, P(0) = Po = Qo"' 



m 



(4.3.78) 



Therefore, the calculation of the inverse in (4.3.77) is avoided by generating P 
as the solution of the differential equation (4.3.78). Similarly, differentiating 
9{t) w.r.t. t and using (4.3.78) and em^ = z — 9 (p, we obtain 



9 = Pec 



(4.3.79) 



We refer to (4.3.79) and (4.3.78) as the continuous-time recursive least- 
squares algorithm with forgetting factor. 

The stability properties of the least-squares algorithm depend on the 
value of the forgetting factor /? as discussed below. 



Pure Least-Squares 

In the identification literature, (4.3.79) and (4.3.78) with /3 = is referred 
to as the "pure" least-squares algorithm and has a very similar form as the 
Kalnian filter. For this reason, the matrix P is usually called the covariance 
matrix. 
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Setting (3 = 0, (4.3.78), (4.3.79) become 
e = Pec^ 
P = -l^tJL^ P{0) = Po (4.3.80) 

In terms of the P~^ we have 



dt m? 

which imphes that ^ ^^ ' > 0, and, therefore, P may grow without bound. 
In the matrix case, this means that P may become arbitrarily small and slow 
down adaptation in some directions. This is the so-called covariance wind-up 
problem that constitutes one of the main drawbacks of the pure least-squares 
algorithm. 

Despite its deficiency, the pure least-squares algorithm has the unique 
property of guaranteeing parameter convergence to constant values as de- 
scribed by the following theorem: 



Theorem 4.3.4 The pure least-squares algorithm (4.3.80) guarantees that 

(i) e,ens,6,6,P e Coo- 

(ii) e,ens,6 e C2. 

(iii) limt^oo ^(0 — ^' where 9 is a constant vector. 

(iv) If Ug^cj) e £00 oLnd 4> is PE, then 6{t) converges to 9* as t ^ cx). 

Proof From (4.3.80) we have that P < 0, i.e., P{t) < Pq. Because P{t) is nonin- 
creasing and bounded from below (i.e., P{t) = -P^(t) > 0,Vi > 0) it has a limit, 
i.e., 

lim P{t) = P 

where P = P^ > is a constant matrix. Let us now consider 

^{p-'e) = -p-^pp-^e + p-'e = ^ + e^ = o 

at m^ 

where the last two equalities are obtained by using 9 = 9, -^P"^ = —P^^pp^^ 
and e = -^ = -^. Hence, P-^(t)9(t) = Po^9{0), and, therefore, 9{t) = 
P{t)P^'^9{0) and limt^oo 0{t) = PP^^9{0), which implies that limt^o^ 9{t) = 9* + 

pp-i^(o) = 9. 
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Because P{t) < Pq and e{t) = P{t)P^^e{0) we have 9,9 e Coo, which, together 

with — G Coo, implies that em = and e, en,, G Coo- Let us now consider the 

function 

The time derivative V oi V along the solution of (4.3.80) is given by 

y = e.-0+^^ = -.W+ — = -— <0 
which implies that V G >Coo, £"2 G C2', therefore, e, eris G £2- From (4.3.80) we have 

l^l<ll^ll-M 

m 

Because P, —,em G Coo and em (z C2, we have ^ G £00 f]C2, which completes the 
proof for (i), (ii), and (iii). The proof of (iv) is given in Section 4.8. □ 



Remark 4.3.16 

(i) We should note that the convergence rate of 6(t) to 9* in Theorem 4.3.4 
is not guaranteed to be exponential even when cp is PE. As shown in the 
proof of Theorem 4.3.4 (iv) in Section 4.8, P{t), 0{t) satisfy 

777 ^ P 777 ^ 

P{t)<——^i, \e{t)\< " 1^(0)1, vt>ro 

where fh = sup^ m'^{t), i.e., \0{t)\ is guaranteed to converge to zero with 
a speed of j. 
(ii) The convergence of 9{t) to ^ as t ^ 00 does not imply that 6{t) ^ as 
t ^ 00 (see examples in Chapter 3). 

(iii) We can establish that e, ^ as i ^ 00 if we assume that 4>/m, ra/m G 
Coo as in the case of the gradient algorithm based on the instantaneous 
cost. 



Pure Least-Squares with Covariance Resetting 

The so called wind-up problem of the pure least-squares algorithm is avoided 
by using various modifications that prevent P{t) from becoming singular. 
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One such modification is the so-called covariance resetting described by 

e = Pe(p 

. P(j)(j)'^P 



m? 



P{t+) = Po = Pol (4.3.81) 



where tr is the time for which \min{P{t)) ^ Pi and po > Pi > are some 
design scalars. Because of (4.3.81), P{t) > pi/ Vi > 0; therefore, P is 
guaranteed to be positive definite for all t > 0. 

Strictly speaking, (4.3.81) is no longer the least-squares algorithm that 
we developed by setting V J{9) = and f3 = 0. It does, however, behave as 
a pure least-squares algorithm between resetting points. The properties of 
(4.3.81) are similar to those of the gradient algorithm based on the instan- 
taneous cost. In fact, (4.3.81) may be viewed as a gradient algorithm with 
time-varying adaptive gain P. 

Theorem 4.3.5 The pure least-squares with covariance resetting algorithm 
(4-3.81) has the following properties: 

(i) e,ens,6,6 e Coo- 

(ii) e,ens,9 e C2- 

(iii) Ifns,(j) e £00 o-nd 4> is PE then 9{t) converges exponentially to 6*. 

Proof The covariance matrix P{t) has elements that are discontinuous functions 
of time whose values between discontinuities are defined by the differential equation 
(4.3.81). At the discontinuity or resetting point t.^, P{t^) = Pq = poP, therefore, 
p-i(t+) = p-^I. Between discontinuities j-^p-^{t) > , i.e., p-^{t2)-P^^{ti) > 
Vt2 > h > such that U [^1,^2], which implies that P^'^{t) > Po^I,\/t > 0. 
Because of the resetting, P{t) > piP\/t > 0. Therefore, (4.3.81) guarantees that 

PoI>P{t)>PiP Pi^I>P~\t)>Po^I, Vi>0 
Let us now consider the function 

/jT p—ln 

V{0) = -^— (4.3.82) 

where P is given by (4.3.81). Because P~^ is a bounded positive definite symmetric 
matrix, it follows that V is decrescent and radially unbounded in the space of 6. 
Along the solution of (4.3.81) we have 

^nTd{P-'), , ,-T„-li5_ 2 2 , ^,Td{P- 



V= -9' -^ '-6 + 9 ' P''9 = -e^m-' + -9 



2 dt 2 dt 
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Between resetting points we have from (4.3.81) that ^ ^^ ' = ^^; therefore, 

2 2 1 (F,?!))2 £2 2 

V = -e^m^ + - ^ — V^ = < 4.3.83) 

2 m^ 2 

Vt e [^1,^2] where [^1,^2] is any interval in [0, c») for which tr ^ [^1,^2]. 
At the points of discontinuity of P, we have 

v{t+) - v{tr) = \e^{p-\t+) - p-\tr))e 

Because P"^(t+) = ■^I,P-'^{tr) > \l, it follows that V{t+) - V{tr) < 0, which 
implies that V^ > is a nonincreasing function of time for alH > 0. Hence, V G Coo 
and limt^oo Vit) = Kx) < 00 • Because the points of discontinuities tr form a set 
of measure zero, it follows from (4.3.83) that em, e G £2- From V G £00 and 
Pi I > P~^{t) > Pq I we have 9 G Coo, which implies that e,em G Coo- Using 
em G £00 n '^2 and pol > P > pil we have 6 G £00 0^2 and the proof of (i) and 
(ii) is, therefore, complete. 

The proof of (iii) is very similar to the proof of Theorem 4.3.2 (iii) and is 
omitted. □ 



Modified Least-Squares with Forgetting Factor 

When /3 > 0, the problem of P{t) becoming arbitrarily small in some direc- 
tions no longer exists. In this case, however, P(t) may grow without bound 
since P may satisfy P > because PP > and the fact that —^^2 — is only 
positive semidefinite. 

One way to avoid this complication is to modify the least-squares algo- 
rithm as follows: 

e = Pe(p 

^- if||P(i)ll<i?o (4.3.84) 

otherwise 

where P(0) = Pq = Pq > 0, \\Po\\ < Rq and Rq is a constant that serves 
as an upper bound for ||-P||. This modification guarantees that P £ £00 
and is referred to as the modified least-squares with forgetting factor. The 
above algorithm guarantees the same properties as the pure least-squares 
with covariance resetting given by Theorem 4.3.5. They can be established 
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by choosing the same Lyapunov-hke function as in (4.3.82) and using the 

dt 



identity ^^^— = -p-^pp-^ to estabUsh 



dP-' ^ I -/9P-1 + t^ if ll^ll < Ro 

dt (^ otherwise 

where P~^(0) = Pq , which leads to 

^^ r _e^_i0Tp-lQ jf ||P||<i?o 

1 — ^4r- otherwise 



Because V < — '' ™ < and P{t) is bounded and positive definite Vt > 0, 
the rest of the analysis is exactly the same as in the proof of Theorem 4.3.5. 

Least-Squares with Forgetting Factor and PE 

The covariance modifications described above are not necessary when ris, 
(j) e Coo and (j) is PE. The PE property of <p guarantees that over an interval of 
time, the integral of —P^^P is a negative definite matrix that counteracts 
the effect of the positive definite term PP with /3 > in the covariance 
equation and guarantees that P £ £oo- This property is made precise by the 
following corollary: 

Corollary 4.3.2 Ifrig, (j) £ C^o and (j) is PE then the recursive least-squares 
algorithm with forgetting factor /? > given by (4.3.78) and (4.3.79) guar- 
antees that P,P~^ e £oo o,nd that 9{t) converges exponentially to 6*. 

The proof is presented in Section 4.8. 

The use of the recursive least-squares algorithm with forgetting factor 
with (f) e Coo and (p PE is appropriate in parameter estimation of stable 
plants where parameter convergence is the main objective. We will address 
such cases in Chapter 5. 

Let us illustrate the design of a least-squares algorithm for the same 
system considered in Example 4.3.1. 

Example 4.3.4 The system 

z = W{s)Asm{ujt + (fi) 



200 CHAPTER 4. ON-LINE PARAMETER ESTIMATION 

where A, ip are to be estimated on-line is rewritten in the form 

z = ^*^0o 

where 9* = [Ai , A2]^ , (f>o = W{s)(f>,(f> = [smujt,cosujt]^ . The least-squares algo- 
rithm for estimating 9* is given by 

9 = Pe4,o 
P = i3P-p'M^P, P{0) = poI 

where e = ^~ 2 , "i^ = 1 -|- (pQ <po and (3 > 0, po > are design constants. Because 
(j)o is PE, no modifications are required. Let us simulate the above scheme when 
A= W,ip = 16° = 0.279 rad,cj = 2 rad/sec, W^(s) = ■^. Figure 4.10 gives the 
time response of A and ip, the estimate of A and ip, respectively, for different values 
of p. The simulation results indicate that the rate of convergence depends on the 
choice of the forgetting factor /3. Larger f3 leads to faster convergence of A, (p to 
A=lQ,ip = 0.279, respectively. V 



4.3.7 Effect of Initial Conditions 

In the previous sections, we developed a wide class of on-line parameter 
estimators for the linear parametric model 

z = VF(s)r^V + % (4.3.85) 

where tjq, the exponentially decaying to zero term that is due to initial 
conditions, is assumed to be equal to zero. As shown in Chapter 2 and in 
Section 4.3.3, 770 satisfies the equation 

Wo = AcU^o, wo(0) = BqXq 

m = C^ujo (4.3.86) 

where Ac is a stable matrix, and xq is the initial value of the plant state at 
t = 0. 



A 



A (t) sin (lt+ (p (0 ) 
Asin (lt+ (p) 



Figure 4.10 Simulation results of Example 4.3.4 for the least-squares algo- 
rithm with forgetting factor and PE signals. 



Let us analyze the effect of rjQ on the gradient algorithm 

: = e'^cf) (4.3.87) 



z — z 



(f) = W{s)Tp 

that is developed for the model (4.3.85) with ?7o = in Section 4.3.5. 

We first express (4.3.87) in terms of the parameter error 9 = 9 — 9*, i.e., 

9 = Ted) 
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r^ + r]o 



m? m? 



(4.3i 



It is clear that rjQ acts as a disturbance in the normahzed estimation er- 
ror and, therefore, in the adaptive law for 9. The question that arises now 
is whether 770 will affect the properties of (4.3.87) as described by Theo- 
rem 4.3.2. We answer this question as follows. 
Instead of the Lyapunov-like function 

Vii) - ^ 
used in the case of 770 = 0, we propose the function 

V{6,ujq) = ^ h ujIPqujq 

where Pq = Pq > satisfies the Lyapunov equation 

PoAc + AjPo = -70/ 
for some 70 > to be chosen. Then along the solution of (4.3.87) we have 

V 
Because rjo = CJujq we have 



V = 0^ (j)t - 7o|woP = -t^rn^ + trjQ - 7o|tJoP 



2^2 I \\\r<T\\, ,1 „ I, , |2 



V < -t m + |e||Co ll^ol - 701^^0 

,2^2 1 / I, , I \ 2 / ir'T|2 

f "^ ^ I^Ti I'^ol \ I |2 / l<-^0 I 



< 7. o e"^-|C'ol - kol 70 



2 \ m / \ 2Tn^ 



By choosing 70 > 2 "^^ have 



e^m? 



00 



V < <0 

2 - 

which implies that 9 e £00, ew- £ ^^2. Because ?7o £ >Coon'^2 and ^ £ >C 
we have e,em,9 G vCoon^2- Hence, (i) and (ii) of Theorem 4.3.2 also hold 
when ?7o / 0. In a similar manner we can show that rjQ ^ does not affect 
(iii) of Theorem 4.3.2. As in every dynamic system, 770 / will affect the 
transient response of 9(t) depending on how fast ??o(0 ^ as t ^ 00. 

The above procedure can be applied to all the results of the previous sec- 
tions to establish that initial conditions do not affect the established prop- 
erties of the adaptive laws developed under the assumption of zero initial 
conditions. 
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4.4 Adaptive Laws with Projection 

In Section 4.3 we developed a wide class of adaptive laws for estimating the 
constant vector 9* that satisfies the linear parametric model 

z = W{s)e*^tp (4.4.1) 

by allowing 9* to lie anywhere in 7?,". In many practical problems where 9* 
represents the parameters of a physical plant, we may have some a priori 
knowledge as to where 9* is located in 7?-". This knowledge usually comes in 
terms of upper or lower bounds for the elements of 9* or in terms of a well- 
defined subset of TZ"", etc. One would like to use such a priori information 
and design adaptive laws that are constrained to search for estimates of 
9* in the set where 9* is located. Intuitively such a procedure may speed 
up convergence and reduce large transients that may occur when ^(0) is 
chosen to be far away from the unknown 9*. Another possible reason for 
constraining 9{t) to lie in a certain set that contains 9* arises in cases where 
9{t) is required to have certain properties satisfied by all members of the set 
so that certain desired calculations that involve 9(t) are possible. Such cases 
do arise in adaptive control and will be discussed in later chapters. 

We examine how to modify the adaptive laws of Section 4.3 to handle 
the case of constrained parameter estimation in the following sections. 

4.4.1 Gradient Algorithms with Projection 

Let us start with the gradient method where the unconstrained minimization 
of J{9) considered in Section 4.3.5 is extended to 

minimize J(9) 
subject to 6* G 5 (4.4.2) 

where 5 is a convex set with a smooth boundary almost everywhere. Let S 
be given by 

S = {9en''\ g{9)<0} (4.4.3) 

where g : TZ^ h^ R is a smooth function. The solution of the constrained 
minimization problem follows from the gradient projection method discussed 
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in Appendix B and is given by 

-TV J if e 50 

or ^ e 5{S) and -(rVJ)^V5<0 



^ = Pr(-rVJ) = 



-rVJ + r^^rVJ otherwise 



(4.4.4) 

where S^ is the interior of S, 5(S) is the boundary of S and 6(0) is chosen 
to be in S, i.e., 6(0) e S. 

Let us now use (4.4.4) to modify the gradient algorithm 6 = — TV J(^) = 
Tecj) given by (4.3.52). Because VJ = —e(f), (4.4.4) becomes 



= Pr(re(/ 



re</)-r^^re0 otherwise 



if ^ e 50 

or if 6* e 5{S) and {Te4>yVg < 



(4.4.5) 
where 61(0) £ 5. 

In a similar manner we can modify the integral adaptive law (4.3.60) by 
substituting VJ = R(t)9 + Q(t) in (4.4.4). 

The principal question we need to ask ourselves at this stage is whether 
projection will destroy the properties of the unconstrained adaptive laws 
developed in Section 4.3.5. This question is answered by the following The- 
orem. 

Theorem 4.4.1 The gradient adaptive laws of Section 4-3-5 with the pro- 
jection modification given by (4.4-4) retain all their properties that are estab- 
lished in the absence of projection and in addition guarantee that ^ e 5 Vt > 
provided 9(0) = 0o e S and 9* e S. 

Proof It follows from (4.4.4) that whenever 6 G S{S) we have 9^\7g < 0, which 
implies that the vector 9 points either inside S or along the tangent plane of 6{S) 
at point 6. Because ^(0) = 9o ^ S, it follows that 9{t) will never leave S, i.e., 
9{t) eSyt>0. 

The adaptive law (4.4.4) has the same form as the one without projection except 
for the additional term 

Q = I r^^rVJ if 9 e S{S) and -{TVjyVg > 
I otherwise 

in the expression for 9. If we use the same function V as in the unconstrained case 
to analyze the adaptive law with projection, the time derivative y of y will have 
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the additional term 

0-Tp-iQ ^ I r^^rVJ if e e S{S) and -{TVjyVg > 
1 otherwise 

Because of the convex property of S and the assumption that 6* G S, we have 
e'^Vg = {0 - 0*yVg > when d e 5{S). Because Vg^FV J= (rVJ)^V3<0 
for e e S{S) and -(rVJ)^Vg > 0, it follows that e'^V^Q < 0. Therefore, the 
term r~^Q introduced by the projection can only make V more negative and 
does not affect the results developed from the properties of V, V . Furthermore, 
the C2 properties of 6 will not be affected by projection because, with or without 
projection, 9 can be shown to satisfy 

|^|2 < c|rvj|2 

for some constant c G TZ'^ . □ 

The projection modification (4.4.4) holds also for the adaptive laws based 
on the SPR-Lyapunov design approach even though these adaptive laws are 
not derived from the constrained optimization problem defined in (4.4.2). 
The reason is that the adaptive law (4.3.35) based on the SPR-Lyapunov 
approach and the gradient algorithm based on the instantaneous cost have 
the same form, i.e., 

e = recb 

where e, (p are, of course, not the same signals in general. Therefore, by 
substituting for — FVJ = Tecp in (4.4.4), we can obtain the SPR-Lyapunov 
based adaptive law with projection. 

We can establish, as done in Theorem 4.4.1, that the adaptive laws based 
on the SPR-Lyapunov design approach with the projection modification re- 
tain their original properties established in the absence of projection. 

Remark 4.4.1 We should emphasize that the set S is required to be convex. 
The convexity of S helps in establishing the fact that the projection 
does not alter the properties of the adaptive laws established without 
projection. Projection, however, may affect the transient behavior of 
the adaptive law. 

Let us now consider some examples of constrained parameter estimation. 
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Example 4.4.1 Consider the linear parametric model 

z = r^(/) 

where 6* = [dl,d2,. ■ ■ ,^^]^ is an unknown constant vector, 6^ is known to satisfy 
l^il ^ Po > for some known constant po, sgn{dl) is known, and z,(f) can be 
measured. We would like to use this a priori information about 6^ and constrain 
its estimation to always be inside a convex set S which contains 0* and is defined 
as 

s = {een''\ g{e) = po- eisgn(0*) < 0} 

The gradient algorithm with projection becomes 

' Te(l> ii po - eisgn{ei) < 

or if po - 0isgn{0l) = and {Te4>)^\7g < (4.4.6) 
Tecf) — r „ ^Tp^y Tfi/' otherwise 

where e = ^~ 2 and ^i(O) satisfies Pq — 9i{0)sgn{6l) < 0. For simplicity, let us 
choose r = diag{ji,ro} where 71 > is a scalar and Fg = TJ > 0, and partition 
(j),6 a.s (p = [<f)i, <I>q]^ , = [Oi, Oj]^ where (j)i,Oi G TZ^ . Because 

V3=[-sgn(e*),0,...,0]^ 

it follows from (4.4.6) that 

7ie0i if ^isgn(6i5;) > po or 

if 9isgn{ei) = Po and ■^i(j)iesgn{9l) > (447) 

otherwise \ ■ ■ J 

6*0 = Toecpo 

where ^o(O) is arbitrary and 0i(O) satisfies 6i{0)sgn{6l) > pa- V 



4.4.2 Least-Squares with Projection 

The gradient projection method can also be adopted in the case of the least 
squares algorithm 

= Pe(p 
P = (3P-P^P^ p{0) = Po = Q-^ (4.4.8) 

developed in Section 4.3.6 by viewing (4.4.8) as a gradient algorithm with 
time varying scaling matrix P and e0 as the gradient of some cost function 
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J. If S = {9 ^ 7^" I g(9) < 0} is the convex set for constrained estimation, 
then (4.4.8) is modified as 



e = Pr(Pe(; 



r Pe(/) aees^ 

or if 61 e 5{S) and {Pe(t>)'^Vg < 
Pecf) — P=-Sy^=-Pt<p otherwise 



(4.4.9) 



where ^(0) £ S and 



aT 



(iP - pi±^p if G 5° 

or if 6* e (5(5) and (Pecp^Vg < (4.4.10) 

otherwise 

where P(0) = Pq = Pq^ > 0. 

It can be shown as in Section 4.4.1 that the least-squares with projection 
has the same properties as the corresponding least-squares without projec- 
tion. 

The equation for the covariance matrix P is modified so that at the point 
of projection on the boundary of 5, P is a constant matrix, and, therefore, 
the adaptive law at that point is a gradient algorithm with constant scal- 
ing that justifies the use of the gradient projection method explained in 
Appendix B. 

Example 4.4.2 Let us now consider a case that often arises in adaptive control 
in the context of robustness. We would like to constrain the estimates 6{t) of 9* to 
remain inside a bounded convex set S. Let us choose S as 

s = {een'^le^e-M^ < 0} 

for some known constant Mq such that \9*\ < Mq. The set S represents a sphere in 
7^" centered at 6 = and of radius Mq. We have 

\7g = 2d 

and the least-squares algorithm with projection becomes 

' Pecj) ae^e < m^ 

or if e'^e = M2 and {Pe<l>yd < (4.4.11) 

— gT pg ) Pe0 otherwise 
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where 0{O) satisfies 6'^(0)6'(0) < M^ and P is given by 



pp-p^p iie'^e<M^ 

P= { " or if 6*^6' = M2 and {Pe(j))'^e < (4.4.12) 

] otherwise 

Because P = P^ > and 6^ P6 > when 0^ 9 = Mq, no division by zero occurs in 
(4.4.11). V 



4.5 Bilinear Parametric Model 

As shown in Chapter 2, a certain class of plants can be parameterized in 
terms of their desired controller parameters that are related to the plant 
parameters via a Diophantine equation. Such parameterizations and their 
related estimation problem arise in direct adaptive control, and in particular, 
direct MRAC, which is discussed in Chapter 6. 

In these cases, 6*, as shown in Chapter 2, appears in the form 

z = W{s)[p*i0*^^P + zo)] (4.5.1) 

where p* is an unknown constant; z,tp,zo are signals that can be measured 
and W{s) is a known proper transfer function with stable poles. Because 
the unknown parameters p* , 6* appear in a special bilinear form, we refer to 
(4.5.1) as the bilinear parametric model. 

The procedure of Section 4.3 for estimating 9* in a linear model extends 
to (4.5.1) with minor modifications when the sgn(p*) is known or when 
sgn{p*) and a lower bound po of \p*\ are known. When the sgn(p*) is un- 
known the design and analysis of the adaptive laws require some additional 
modifications and stability arguments. We treat each case of known and 
unknown sgn{p*),po separately. 

4.5.1 Known Sign of p* 

The SPR-Lyapunov design approach and the gradient method with an in- 
stantaneous cost function discussed in the linear parametric case extend to 
the bilinear one in a rather straightforward manner. 
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Let us start with the SPR-Lyapunov design approach. We rewrite (4.5.1) 
in the form 

z = W{s)L{s)p*{e*^(j) + zi) (4.5.2) 

where zi = L~^(,s)zo,(l) = L~^(s)^ and L(s) is chosen so that L~^(s) is 
proper and stable and WL is proper and SPR. The estimate z of z and the 
normalized estimation error are generated as 

z = W{s)L{s)p{e'^c^ + zi) (4.5.3) 

e = z-z-W{s)L{s)en'i (4.5.4) 

where rig is designed to satisfy 

^, ^e£oo, m' = l + nl (A2) 

m m 

and p(t),9(t) are the estimates of p*,6* at time t, respectively. Letting 

p = p- p*,0 = 0-0*,[t follows from (4.5.2) to (4.5.4) that 

e = W{s)L{s)[p*e*^c^ - pzi - pO'^cf) - tn]] 

Now p*r^(^ - p6'^(/> = p*e*'^4> - p*0'^(p + p*9'^(p - p9'^(j) = -p*e'^(j) - po'^cp 

and, therefore, 

e = W{s)L{s) [-p*e'^(j) -p^- enl] , ^ = O'^ (j) + zi (4.5.5) 

A minimal state representation of (4.5.5) is given by 

e = A,e + B,{-p*9^<p - pi - ml) , . 

e = Cje ^^■^■^> 

where Cj {si — Ac)~^Bc = W{s)L{s) is SPR. The adaptive law is now de- 
veloped by considering the Lyapunov-like function 

T./;^ ~^ e'^Pce , ^,9'^T-^O p^ 

V{e,p) = — + \p*\ h — 

"^ " ' 2 '^ ' 2 27 

where Pc = Pj > satisfies the algebraic equations given by (4.3.32) that 
are implied by the KYL Lemma, and T = T > 0, 7 > 0. Along the solution 
of (4.5.6), we have 

T> e^qq^e u j ^ ~j 22,1 *mTp-ii5 , PP 
V = -e LcC — p eO (p — ep^ — e n^ + \p \0 F ^ 
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where u > 0, Lc = LJ > 0. Because p* = \p*\sgn{p*) it follows that by 
choosing 

e = e = TecPsgnip*) ^^ ^^^^ 

p = p = je^ 

we have 

V = — e~Lce - e^nl < 

2 2 ^ - 

The rest of the analysis continues as in the case of the linear model. We sum- 
marize the properties of the bilinear adaptive law by the following theorem. 



Theorem 4.5.1 The adaptive law (4-5.7) guarantees that 

(i) e,9,peCoo- 
(ii) e,ens,6,p e C2. 

(iii) // 0, (/) e £00, (p is PE and ^ e £2, then 9(t) converges to 9* as t —> 00. 
(iv) //^ e £2, the estimate p converges to a constant p independent of the 
properties of (p. 

Proof The proof of (i) and (ii) follows directly from the properties of V, V by 
following the same procedure as in the linear parametric model case and is left as 
an exercise for the reader. The proof of (iii) is established by using the results of 
Corollary 4.3.1 to show that the homogeneous part of (4.5.6) with p^ treated as 
an external input together with the equation of 9 in (4.5.7) form an e.s. system. 
Because p^ G £2 and Ac is stable, it follows that e,6 —> as t —> 00. The details of 
the proof are given in Section 4.8. The proof of (iv) follows from e, ^ G £2 and the 
inequality 



J \p\dT<jJ H\dT<jU e^dTJ U edT 



< 00 



which implies that p G £1. Therefore, we conclude that p{t) has a limit p, i.e., 
Umt^oo p{t) = p. □ 



The lack of convergence of p to p* is due to ^ £ £2- If, however, (p,^ 
are such that (pa = [^P^,^]^ is PE, then we can establish by following the 
same approach as in the proof of Corollary 4.3.1 that 9,p converge to zero 
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exponentially fast. For ^ (^ C2, the vector (pa cannot be PE even when (p is 
PE. 

For the gradient method we rewrite (4.5.1) as 

z = p*{e*^cP + zi) (4.5.8) 

where zi = W{s)zo,(f) = I4^(s)^. Then the estimate z of z and the normal- 
ized estimation error e are given by 



z — z z — p{0^ cp + zi) 



(4.5.9) 



where n1 is chosen so that 

^' e-Coo, m^ = l + ni (A2) 



4> zi ^ ^ __ 2 1,2 



m m 
As in the case of the linear model, we consider the cost function 

e^m^ {z-p*e^<P-pC + p*X-p*zif 

Jip,e) = ^ = ^, 

where ^ = 6 cp+ zi and the second equality is obtained by using the identity 
—p{6^(p + zi) = —p£, — p*0'^ (p + p*^ — p*zi. Strictly speaking J{p, 6) is not a 
convex function of p, 9 over 7Z^^^ because of the dependence of ^ on 6. Let 
us, however, ignore this dependence and treat ^ as an independent function 
of time. Using the gradient method and treating S, as an arbitrary function 
of time, we obtain 

9 = Tip*e(p, /9 = 7eC (4.5.10) 

where Fi = F^ > 0,7 > are the adaptive gains. The adaptive law (4.5.10) 
cannot be implemented due to the unknown p* . We go around this difficulty 
as follows: Because Fi is arbitrary, we assume that Fi = pq- for some other 
arbitrary matrix F = F^ > and use it together with p* = |p*|sgn(p*) to 
get rid of the unknown parameter p*, i.e., Fip* = r^p* = Fsgn(p*) leading 
to 

e = Te(psgn{p*), p = 7e^ (4.5.11) 

which is implement able. The properties of (4.5.11) are given by the following 
theorem. 
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Theorem 4.5.2 The adaptive law (4-5.11) guarantees that 

(i) e,ens,9,9,p,pe Coo- 
(ii) e,ens,9,p e C2- 

(iii) If ns,(j) e £00, (p is PE and ^ e £2, then 9{t) converges to 9* as t^ 00. 
(iv) If C ^ ^2, then p converges to a constant p as t —i- 00 independent of 
the properties of (p- 

The proof follows from that of the linear parametric model and of The- 
orem 4.5.1, and is left as an exercise for the reader. 

The extension of the integral adaptive law and least-squares algorithm to 
the bilinear parametric model is more complicated and difficult to implement 
due to the appearance of the unknown p* in the adaptive laws. This problem 
is avoided by assuming the knowledge of a lower bound for \p*\ in addition 
to sgn(/9*) as discussed in the next section. 

4.5.2 Sign of p* and Lower Bound po Are Known 

The complications with the bilinearity in (4.5.1) are avoided if we rewrite 
(4.5.1) in the form of the linear parametric model 

z = 9*^4> (4.5.12) 

where 9* = [9l,9f]'^,4) = [zi,(/>^]^, and 91 = p* ,91 = p*9*. We can now 
use the methods of Section 4.3 to generate the estimate 9{t) of 9* at each 
time t. From the estimate 9 = \9i, ^J ] ^^ ^*' ^^ calculate the estimate p, 9 
of p*, 9* as follows: 

p{t) = h{t), ^W = ||| (4-5.13) 

The possibility of division by zero or a small number in (4.5.13) is avoided 
by constraining the estimate of 9i to satisfy |^i(t)| > po > for some 
Po ^ \p*\- This is achieved by using the gradient projection method and 
assuming that po and sgn(p*) are known. We illustrate the design of such a 
gradient algorithm as follows: 

By considering (4.5.12) and following the procedure of Section 4.3, we 
generate 

(4.5.14) 



5t: 



m^ 
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where m? = 1 + n^ and Ug is chosen so that (p/m £ Coo, e.g. n^ = 4> 4>. The 
adaptive law is developed by using the gradient projection method to solve 
the constrained minimization problem 

mm J (a) = min ^ 

e e 2m^ 

subject to po — ^isgn(p*) < 
i.e., 

f V4 ifpo-^isgn(p*)<0 

or if po - Oisgn{p*) = and (re(/>)^V5 < 
_ V4-V^f^V4 otherwise 

(4.5.15) 
where g{6) = po — ^isgn(p*). For simphcity, let us assume that V = 
diag{'^i,V2] where 71 > is a scalar and r2 = TJ > and simplify the 
expressions in (4.5.15). Because 

Vff=[-sgn(p*),0,...,0]^ 

it follows from (4.5.15) that 



h 



7ie(/)i if ^isgn(p*) > po 

or if 0isgn(p*) = po and — 7i0iesgn(p*) < (4.5.16) 

otherwise 



where ^i(O) satisfies 0i(O)sgn(p*) > po, and 

62 = V2eh (4.5.17) 

where ^1 = ^i, (^2 = </*. 

Because 6i{t) is guaranteed by the projection to satisfy |^i(i)| > Po > 0, 
the estimate p(t), 6{t) can be calculated using (4.5.13) without the possibility 
of division by zero. The properties of the adaptive law (4.5.16), (4.5.17) with 
(4.5.13) are summarized by the following theorem. 

Theorem 4.5.3 The adaptive law described by (4-5.13), (4.5.16), (4.5.17) 
guarantees that 
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(i) e,ens,p,9,p,0 e Coo- 
(ii) e,ens,p,9 e C2. 

(iii) If ns,(f> e £00 and (j) is PE, then 9,0, p converge to 9*,0*,p*, respec- 
tively, exponentially fast. 

Proof Consider the Lyapunov-like function 

V = -^ + ^2 ^2 ^2 

271 2 

where S^ = 9i - 61, ^2 = ^2 - ^2- Then along the solution of (4.5.16), (4.5.17), we 
have 

—e^m? if ^isgn(p*) > po 



V 



or if 6'isgn(p*) = po and -7i</)iesgn(p*) < (4.5.18) 

^2 02e if ^isgn(p*) = po and -7i0iesgn(p*) > 



Because tm? = —6 (j) = —di<f>i — 62 4>2, we have 02 026 = —£^m'^ — Oie(pi. For 
^isgn(p*) = po (i.e., 9i = poSgn{p*)) and -7i<^_iesgn(p*) > 0, we have 9i(j)ie = 
(posgn(/9*)- \p*\sgn{p*))(j)ie = {po - \p*\)sgn{p*)(j)ie > (because po" |p*l < and 
sgn{p*)(j)ie < 0), which implies that 

e^2 ^2 = -e^m^ - e^i(po - |p*|)sgn(p*) < -e^m^ 



Therefore, projection introduces the additional term — e(/)i(po — |p*l)sgn(p*) that 

can o 
have 



can only make V more negative. Substituting for e02 4>2 < —(^m? in (4.5.18) we 



V < -e^w? 

which implies that 6\,0i G [ioa\ £; ^^s G >Coo ^^2- 

Because (/)/?7i G £00 and e?TT, G >Coon'^2, it follows from (4.5.16), (4.5.17) that 

^,e £000^,^=1,2. 

Using (4.5.13), we have p = 61, 6 = !*■ — %r^, which, together with 6i G 

C.ooC\C2,i = 1,2, l^il > Po > 0, imply that p,0 e CooC\C2- 

The convergence of 9 to 9* follows from that of Theorem 4.3.2 (iii) and the fact 
that projection can only make V more negative. The convergence of 9,p to 9* , p* 
follows from that of 9*, equation (4.5.13), assumption \9l\ > po and |0i(i)| > po 
Vt > 0. D 

In a similar manner one may use (4.5.12) and (4.5.13) to derive adaptive 
laws using the integral cost function and least-squares with 9i constrained 
to satisfy |^i(t)| > po > Vt > 0. 
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4.5.3 Unknown Sign of p* 

The problem of designing adaptive laws for the bilinear model (4.5.1) with 
sgn(p*) unknown was motivated by Morse [155] in the context of MRAC 
where such an estimation problem arises. Morse conjectured that the sgn(/)*) 
is necessary for designing appropriate adaptive control laws used to solve 
the stabilization problem in MRAC. Nussbaum [179] used a simple example 
to show that although Morse's conjecture was valid for a class of adaptive 
control laws, the sgn(p*) is not necessary for stabilization in MRAC if a 
different class of adaptive or control laws is employed. This led to a series of 
results on MRAC [137, 156, 157, 167, 236] where the sgn(p*) was no longer 
required to be known. 

In our case, we use the techniques of [179] to develop adaptive laws for 
the bilinear model (4.5.1) that do not require the knowledge of sgn(p*). The 
design and analysis of these adaptive laws is motivated purely from stability 
arguments that differ from those used when sgn(p*) is known. 

We start with the parametric model 

and generate i, e as 

z = N{x)p{e'^(l) + zi), e=^^ 



where m = 1 + n^ is designed so that ^ , ^ £ J-'oo , 



4>_ Zx 

m 
„2 



iV(x) = x^cosx (4.5.19) 

X is generated from 

p2 

x = w^—; w = <?m^, ii;(0) = (4.5.20) 

27 

where 7 > 0. The following adaptive laws are proposed for generating p, Q: 

e = N{x)Ve(j), p = N{x)-fei (4.5.21) 

where ^ = O'^ (p + Zi. The function N{x) plays the role of an adaptive gain 
in (4.5.21) and has often been referred to as the Nussbaum gain. Roughly 
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speaking, N(x) accounts for the unknown sign of p* by changing the sign of 
the vector field of 9, p periodically with respect to the signal x. 

The design of (4.5.19) to (4.5.21) is motivated from the analysis that is 
given in the proof of the following theorem, which states the properties of 
(4.5.19) to (4.5.21). 

Theorem 4.5.4 The adaptive law (4.5.19) to (4.5.21) guarantees that 

(i) x,w,d,p e Coo 

(ii) e,ens,9,p e Coor\'C'2 

Proof We start by expressing the normalized estimation error e in terms of the 
parameter error 6, i.e., 

em^ = z — z 

= p*e*^(p + p*zi - p*e'^(t> - p*zi + p*i - N{x)pi 

= -p*(r(j) + p*i-N{x)pi (4.5.22) 

We choose the function 



2 
whose time derivative along the solution of (4.5.21) is given by 

V = F(t>eN{x) (4.5.23) 

Substituting ^^(?!) = W- trn^ + p* i - N [x) pi] from (4.5.22) into (4.5.23), we obtain 

V = - ^^ [e^m^ - P*ei + N{x)pei] 
p* 



y_ ^(^) 



2 2 , PP 



P_ 

7 



From (4.5.20), we have x = e ttt. + — which we use to rewrite V as 

N(x)x p 

V = ^^ + - (4.5.24) 

P* 7 

Integrating (4.5.24) on both sides we obtain 

7 P* Jo 
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Because N{x) = x^ cos x and /„ cr^ cos ada = 2x cos x + (x^ — 2) sin a;, it follows 
that 

V{t) - y (0) = ^^^^ ~ ^^°^ - — [2a; cos x + {x^ - 2) sin x] (4.5.25) 

7 P* 

2 

From X = zt) + |- and w > 0, we conclude that x{t) > 0. Examination of (4.5.25) 
shows that for large x, the term x^sinx dominates the right-hand side of (4.5.25) 
and oscillates between — x^ and x^. Because 

Tw X Tw X pit) — p(0) 1 , , x^sinx 

V{t) = V{0) + '-^ f-^-^ [2x cos X - 2 sin x] 

7 p* p* 

and V{t) > 0, it follows that x has to be bounded, otherwise the inequality V > 
will be violated for large x. Bounded x implies that V, w, p,0 £ Ceo- Because w{i) = 
L e^m^dt is a nondecreasing function bounded from above, the limt_,oo w'(i) = 
L e^m?dt exists and is finite which implies that tm G L2, i.e., e, erig G £2- The 
rest of the proof follows directly as in the case of the linear parametric model and 
is omitted. □ 



4.6 Hybrid Adaptive Laws 

The adaptive laws developed in Sections 4.3 to 4.5 update the estimate 9{t) 
of the unknown parameter vector 6* continuously with time, i.e., at each 
time t we have a new estimate. For computational and robustness reasons it 
may be desirable to update the estimates only at specific instants of time t^ 
where {t^} is an unbounded monotonically increasing sequence in TZ'^ . Let 
tfc = kTg where Tg = t^+i — t^ is the "sampling" period and A; = 0, 1, 2, . . . ,. 
Consider the design of an adaptive law that generates the estimate of the 
unknown 6* at the discrete instances of time t = 0, T^, 2T5, • • • . 

We can develop such an adaptive law for the gradient algorithm 



(4.6.1) 



^ (4.6.2) 



where z is the output of the linear parametric model 

z = e*^4> 
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and 

z = e^(j) (4.6.3) 

Integrating (4.6.1) from t^ = kTg to t^+i = {k + l)Ts we have 

0fc+i = 0fc + r / '^' e(r)0(r)dT, ^o = ^(0), fc = 0, 1,2, . . . (4.6.4) 
Jtk 

where 9^ = 0{tk)- Equation (4.6.4) generates a sequence of estimates, i.e., 
00 = 0(0), 01 = 0(T,), 02 = 0(2T,), . . . ,0fc = 0(fcT,) of 9*. 

If we now use (4.6.4) instead of (4.6.1) to estimate 0*, the error e and z 
have to be generated using Ok instead of 0(t), i.e., 

z{t) = Olm, ^W = ^^^^^(^' Vte[tfc,t,+i] (4.6.5) 

We refer to (4.6.4), (4.6.5) as the hybrid adaptive law. The following 
theorem establishes its stability properties. 

Theorem 4.6.1 Let m,Ts,T be chosen so that 

(a) ^ < 1, m > 1 

(b) 2 — TsX„i > 7 for some 7 > 

where Xm = Amax(r)- Then the hybrid adaptive law (4-6.4), (4-6.5) guaran- 
tees that 

(i) Ok^loo- 

(ii) A0fc e I2; e, em e £00 n -^2, w/iere A0fc = 0fc+i - 0fc- 

(iii) If m,(f) ^ Coo o-nd <p is PE, then 9k ^ 9* as k ^ 00 exponentially fast- 

Proof As in the stability proof for the continuous adaptive laws, we evaluate the 
rate of change of the Lyapunov-like function 

V{k) = ejT-^h (4.6.6) 

along the trajectory generated by (4.6.4) and (4.6.5), where 9^ = Ok — 6* . Notice 
that 

AT/(A:) = {2~0k + Mk^T-^Mk 
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where AV{k) = V{k + 1) - V{k). Using (4.6.4) we obtain 



AV{k) = 2eJ I ^ e{T)4>{T)dT + ( I ^ e{T)<i>{T)dT) T/ e{T)<t){T)dT 

Because em^ = —9j(f>{t) and X„i > \\T\\, we have 

AV{k) <-2 f '^' e\T)m\T)dT + \^ ( f '^' |e(T)m(r)|^^dT') (4.6.7) 

Using the Schwartz inequahty, we can estabUsh that 



2 



"''Hr)mir)mA < ^ e\r)m\r)dr T ( ^^) dr 



< Ts I e^{T)m^{T)dT (4.6.8) 

•Jtk 

where the last inequahty follows from assumption (a). Using (4.6.8) in (4.6.7), it 
follows that 

AV{k) <-{2-T,Xm) I ^ e^{T)m^{T)dT (4.6.9) 

Therefore, if 2 — TaXm > 7 for some 7 > 0, we have A.V{k) < 0, which implies 
that V{k) is a nonincreasing function and thus the boundedness of V{k),9k and 6k 
follows. From (4.6.9), one can easily see that 






.2,_^._^ y(0)-i/(fc+i) 



We can establish that limfc^oo l^(fc + 1) exists and, from (4.6.10), that em G 
C-oa n ^^2- Because tti > 1, it follows immediately that e G £00 H ^^2. 
Similarly, we can obtain that 

AejAOk < TsXl, I "^^ e^{T)m^{T)dT (4.6.11) 

Jtk 

by using the Schwartz inequality and condition (a) of the theorem. Therefore, 

°^ /.CX) 

fc=l -^0 

which implies A^^ G ?2 and, thus, completes the proof for (i) and (ii). 

The proof for (iii) is relatively involved and is given in Section 4.8. □ 
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For additional reading on hybrid adaptation the reader is referred to [60] 
where the term hybrid was first introduced and to [172, 173] where different 
hybrid algorithms are introduced and analyzed. 

The hybrid adaptive law (4.6.4) may be modified to guarantee that 
9k £ Tl^ belongs to a certain convex subset S of T?." by using the gradi- 
ent projection method. That is, if S is defined as 

S = {9en''\e'^9< M^} 

then the hybrid adaptive law (4.6.4) with projection becomes 

4+1 = 9k + T r^' e{T)^{T)dT 
•Itk 

{9k+i if 9k+i e S 

I^Mo if 4+1 5 

and ^0 £ S. As in the continuous-time case, it can be shown that the hybrid 
adaptive law with projection has the same properties as those of (4.6.4). In 
addition it guarantees that 9^ ^ S,\/k > 0. The details of this analysis are 
left as an exercise for the reader. 

4.7 Summary of Adaptive Laws 

In this section, we present tables with the adaptive laws developed in the 
previous sections together with their properties. 

4.8 Parameter Convergence Proofs 

In this section, we present the proofs of the theorems and corollaries of the previous 
sections that deal with parameter convergence. These proofs are useful for the 
reader who is interested in studying the behavior and convergence properties of the 
parameter estimates. They can be omitted by the reader whose interest is mainly on 
adaptive control where parameter convergence is not part of the control objective. 

4.8.1 Useful Lemmas 

The following two lemmas are used in the proofs of corollaries and theorems pre- 
sented in this sections. 
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Table 4.1 Adaptive law based on SPR-Lyapunov design approach 



Parametric model 



z = w{s)e*' 4j 



Parametric model 
rewritten 



z = W{s)L{s)e*^(l), (p = L-\s)'tp 



Estimation model 



z = W{s)L{s)e'^(f) 



Normalized 
estimation error 



e = z — z — W{s)L{s)enl 



Adaptive law 



Peo 



Design variables 



L~^(.s) proper and stable; W{s)L(.s) proper and 
SPR; m^ = 1 + n^ and n^ chosen so that ^G £oo 
(e. g., n^ = a(p (p foi' some a > 0) 



Properties 



(i) e,9 e Coo; (ii) e, e^s, ^ C2 



Lemma 4.8.1 (Uniform Complete Observability (UCO) with Output In- 
jection). Assume that there exists constants z/ > 0, /c^ > such that for all to > 0, 

K{t) e TZ"^ satisfies the inequality 

(■ta + v 

\K{T)\^dT<K (4.8.1) 

\/t>Q and some constants ko,v > 0. Then {C,A), where C e U'^'^^A e W"^", is 
a UCO pair if and only if (C, A + KC~^) is a UCO pair. 

Proof We show that if there exist positive constants /3i,/32 > such that the 
observability graniniian iV(io,^o + '^) of the system {C,A) satisfies 

l3iI<N{to,to + i^)<!32l (4.8.2) 

then the observability graniniian Ni{to, to + ly) of [C, A + KC^) satisfies 

li'il < Ni{toM + i^) < li'21 (4.8.3) 

for some constant (3-^^,02 > 0- From the definition of the observability graniniian 
matrix, (4.8.3) is equivalent to 
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Table 4.2 Gradient algorithms 


Parametric model 


z = e*'^<t) 


Estimation model 


z = e'^(j) 


Normalized 
estimation error 


z — z 




A. 


Based on instantaneous cost 


Adaptive law 


B = Vt(t) 


Design variables 


m2 = 1 + nl, nl = a(f)'^<t>, a > 0, P = P^ > 


Properties 


(i) e, eus, 9,9 e Coo] (ii) e, ef^s, 9 e C2 


B 


. Based on the integral cost 


Adaptive law 


= -T{R9 + Q) 

R= 0R+^^^, i?(0) = 

Q = -i3Q-^, g(o) = o 


Design variables 


m? = l + nl, Us chosen so that <p/m G £00 (e. 
g., nl = a<f^(t), a>0);/3>0, P = P^>0 


Properties 


(i) e,ens,9,6,R,Q e £00; (h) e,ens,6 e £2 ; 
(iii) hmt^oo ^ = 



l3[\xi{to)\^ < [" |C^(t)xi(f)|2dt</3;|a:i(to)|' 

where Xi is the state of the system 

xi = {A+KC^)xi 
Vi = C^xi 

which is obtained, using output injection, from the system 

Table 4.3 Least-squares algorithms 



(4.8.4) 



(4.8.5) 
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Parametric model 


z = 0*^(j) 


Estimation model 


z = e^(P 


Normalized 
estimation error 


e={z- z)/m^ 


A. Pure least-squares 


Adaptive law 


9 = Peep 

P = -pi^P, P(0) = Po 


Design variables 


Po = P(7 > 0; m"^ = I + n^ Us chosen so that 
(p/m e £oo (e.g., n1 = a(f)^4>,a > or n^ = 
,p-^PcP) 


Properties 


(i) e,ens,0,9,P G £oo; (h) e,ens,9 G £2; (hi) 

limi^oo 0{t) = e 


B. Least-squares with covariance resetting 


Adaptive law 


e = Pt(t) 

P = -pi^P, P(t+) = Po = poI, 
where tr is the time for which \min{P) ^ Pi 


Design variables 


Po > pi > 0; m^ = 1 + n^, Ug chosen so that 
4>/m e £00 (e.g., n1 = a(f)^ (j), a > ) 


Properties 


(i) e, en„ e,0,PeCoo; (h) e, en^J G £2 


C. Least-squares with forgetting factor 


Adaptive law 


= Pe(p 

p^i pp-p^p, ^f\\pm<Ro 

\ otherwise 
P{0) = Po 


Design variables 


m2 = 1 + n% nl = a<^~^ 4> or <f^ P<^; /? > 0, Pq > 
scalars; Pq = Pq^ > 0, ||Po|| < Pq 


Properties 


(i) e, en^, 6,0,P ^ C^o; (ii) e, en^, ^ G £2 
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Table 4.4 Adaptive laws for the bilinear model 



Parametric model : z = W{s)p*{9 tp + zq) 


A. SPR-Lyapunov design: sign of p* known 


Parametric model 
rewritten 


z = W{s)L{s)p*{9*'^^ + zi) 
(j) = L-'^{s)ij,zi = L-'^{s)zo 


Estimation model 


z = W{s)L{s)p{e'^<P + zi) 


Normalized 
estimation error 


e = z-z- W(s)L(s)€n^, 


Adaptive law 


e = re,^sgn(p*) 


Design variables 


L~^{s) proper and stable; W{s)L{s) proper and 
SPR; m^ = l + n^; Ug chosen so that ^, f^e £oo 
(e.g. n^ = a{cl)'^4> + zf), a > 0); P = P^ > 0,7 > 


Properties 


(i) e,e,pe Coo; (ii) e, en^, 0,pe C2 


B. Gradient algorithm: sign(p*) known 


Parametric model 
rewritten 


z = p*{e*^cp + zi) 

,p = W{s)ip,zi = W{s)zo 


Estimation model 


z = p{e'^<p + zi) 


Normalized 
estimation error 


z — z 


'- 9 


Adaptive law 


e = Tec^sgnip*) 


Design variables 


m'^ = 1 + nl; Us chosen so that ^, ^ e £00 (e.g., 
n^^ = 4>'^ (P + zf); T = T^ > 0,j > 


Properties 


(i) e, eus, 9, p,0,p e Coo] (ii) e, eUg, 9,p e C2 



X = Ax 
y = C^x 



(4.8.6) 



A 



Form (4.8.5) and (4.8.6), it follows that e = Xi — x satisfies 

e = Ae+ KC^xi 
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Table 4.4 (Continued) 



C. Gradient algorithm with projection 
Sign (p*) and lower bound < po < \p*\ known 


Parametric model 
rewritten 


z = 6**^0 

0* = [9i,ef]'^,9i = p*,ei = p*e* 


Estimation model 


z = e^4> 


Normalized 
estimation error 


z — z 




Adaptive law 


0i=< 

k = 
p = i 


'7iezi if 6'isgn(p*) > Po or 

if ^isgn(p*)=po and -7iziesgn(p*) <0 
^ otherwise 

r2e</> 


Design variables 


rn^ = 1 + n^; n^ chosen so that — £ £oo (e-g-, n^ = 
a4>'^4>, a > ); 71 > 0; ^i(O) satisfies |0i(O)| > po; 

r2 = rj >o,7>o 


Properties 


(i) e, ens, 0, P,d,p e Coo', (ii) e, trig, 9,p ^ C2 


D. Gradient algorithm without projection 
Unknown sign (p*) 


Parametric model 


z = p*ie*^(t> + zi) 


Estimation model 


z = N{x)p{d'^^ + zi) 

N{x) = x^cosx 

X = w + ^,w = t^m?, tt;(0) = 


Normalized 
estimation error 


z — z 




Adaptive law 


e = N{x)re(P 

p = N{xhe^, C = e'^<P + zi 


Design variables 


m? = 1 + n^; n, chosen so that — , — £ £00; (e.g., 

nl = cf^(t) + zf ); 7 > 0, r = r^ > 


Properties 


(i) e, ens, 0, P, 6, p,x,w ^ Coo', (ii) e, eus, 6,p ^ C2 
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Table 4.5. Hybrid adaptive law 



Parametric model 


z = e*^(p 


Estimation model 


z = ejcp,te [tk,tk+i) 


Normalized 
estimation error 


z — z 


'- 9 


Adaptive law 


Ok+i = Ok + F Jl'+' e{T)cP{T)dT, fc = 0, 1, 2, . . . , 


Design variables 


Sampling period Ts = tk+i — tfc > 0, tfc = kTs] 
m? = l+n1 and Ug chosen so that \<j)\/m < 1 
(e.g., n1 = a<f>^(t>, a > 1 ) 

r = r^ > 

2 — TsXmax(F) > 7 for some constant 7 > 


Properties 


(i) Ok e loo, e, ens e £00 

(ii) \9k+i - Ok\ eh ; e,ens G £2 



Consider the trajectories x{t) and xi{t) with the same initial conditions. We 



have 

e{t)= f <^{t,T)K{T)C'^{T)xi{T)dT 
Jta 

where $ is the state transition matrix of (4.8.6). Defining 



(4.8.7) 



_ ^{ KC'^xi/\KC'^xi\ ifjC^xilT^O 
^i""* K/\K\ if |C^xi| = 



we obtain, using the Schwartz inequality, that 



|C^(i)e(i)|2 < / |C^(i)$(i,T)X(r)C^(T)xi(T)| dr 



to 
t 9 /■* 9 

< / |C^(i)$(i,T)a;i(T)| \K{T)\'^dT \C^{t)xi{t)\ dr (4.8.8) 

'tn J to 
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Using the triangular inequality (a + 6)^ < 2a^ + 26^ and (4.8.8), we have 

\C^{t)xi{t)\^dt<2 f" \C^{t)x{t)\'^dt + 2 f" \C^{t)e{t)\^dt 

to ^ to -/ to 

< 2 /"" \C^{t)x{t)\^dt 

Jto 
+ 2 r I \C^{t)<^{t,T)xi{T)\^\K{T)\^dT f \C^{T)xi{T)\^dTdt 

^ to ^ t(_) 'J to 

< 2/32|xi(io)|' 

/tQ-\-iy ft f't 

/ |C^(i)$(f,T)xi(T)f |if(T)|2dT / |C^(T)xi(r)f drdt 

where the last inequality is obtained using the UCO property of [C,A) and the 
condition that x(to) = a;i(io)- Applying the B-G Lemma, we obtain 

\C^{t)x^{t)\'dt<2(i2\xi{h)\\y-''^^ ■^'« ' ^'^ ^ ^^1' ^^' / (4,8,9) 
By interchanging the sequence of integration, we have 

' C'^{t)^{t,T)xi{T)\^\K{T)\^dTdt= I " j " |C^(t)$(i,r)a;i(r)|^di|K(r)pdT 

'to •'ta Jta Jt 

Because {C,A) being UCO and |xi| = 1 imply that 

|C^(t)$(i,T)xi(r)|^di< /" |C^(i)$(i,r)|^di</32 

Jta 



for any t^ < t < t^ -\- v , it follows from (4.8.1) and the above two equations that 

|C^(i)$(t,T)xi(T)|^ \K{T)\'^dTdt < fc^/32 (4.8.10) 



' ^0 ^ to 

and, therefore, (4.8.9) leads to 

\C^{t)xi{t)\^dt<2l32e''f^-''"\xi{to)\'' (4.8.11) 

On the other hand, using xi = x+e and the triangular inequality (a+6)^ > ^a^ — b^, 
we have 

\C'^{t)xi{t)\'^dt > - / \C^{t)x{t)\^dt- / \C^{t)e{t)\^dt 



2 

to ^ to ^ to 



> (^\x,{to)\^- f" '^\C^{t)e{t)\^dt (4.8.12) 



2 
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where the last inequaUty is obtained using the UCO property of (C, A) and the fact 
x{to) = xi{ta). Substituting (4.8.8) for |C^ep, we obtain 



to + i^ 
to 



C^{t)xiit)\^dt> (j\xi{to)\' 



to / Jto J to 

by using the fact that 

|C^(T)xi(T)|2dr< /" V^(T)xi(T)|2dr 

to -^to 

for any t <to -\- i/. Using (4.8.10), we have 

|C^(i)xi(i)|2di > ^|xi(io)|' - P2K I " "" \C^{t)x^{t)\''dt 

■J to 

or 

f"^^ \C^{t)x,[t)\''dt > ^,, !l\ , M h)? (4.8.13) 

Jto 2(1 + I32ky) 

Setting I3[ = 2(i+Lk ) '/^a = 202^'^'^''''", we have shown that (4.8.4) holds for 
/3j^,/32 > and therefore {C,A + KC^) is UCO, and, hence, the if part of the 
lemma is proved. 

The proof for the only if part is exactly the same as the if part since (C, A) can 
be obtained from (C, A + KC^) using output injection. D 



Lemma 4.8.2 Let H{s) he a proper stable transfer function and y = H{s)u. If 
u e Loo, then 

ft+T ft+T 

y'^{T)dT < fci / u^{T)dT + k2 
It Jt 

for some constants ki,k2 > and any f > 0,T > 0. Furthermore, if H{s) is strictly 
proper, then ki < a\\H{s)\\'^ for some constant a > 0. 

Proof Let us define 

" /(r) ifre^ 



^0 otherwise 

where iS C 7?, is a subset of TZ that can be an open or closed interval. Then we can 
write 

u{t) = M[o,t)(-r) + M[t,t+T](-r), VO < T < i + T 
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Because H{s) can be decomposed as H{s) = ho + -ffi(s) where ho is a constant and 
Hi{s) is strictly proper, we can express y = H{s)u as 

2/(r) = hau{T) + Hi{s) {^[o,*) + un^t+T]} = hou{T) + yi{T) + y2{T), VO < r < t + T 

where yi = Hi{s)u!Q^f\,y2 = Hi{s)uuj.^x]- Therefore, using the inequahty 



{a+b + cf < 3a^ + 36^ + 3c^ 



we have 



t+T rt+T ft+T ft+T 

y^{T)dT <?,hl u^{T)dT + ?, yl{T)dT + ^ vl{T)dT (4.8.14) 

t Jt Jt Jt 

Using Lemma 3.3.1, Remark 3.3.2, and noting that 2/2(t) = for all r < i, we have 

ft+T i-t+T 



A 
y2{T)d'T 

t Jo 



Vl{r)dr = / yl{T)dT = ||y2(*+T)||^ < \\Hi{s)\\UH,t+T]\\l 



where 

^oo j-t+T 

,2 ,_\j / ..2 

''[t,t+T] 

It 



\W[t,t+T\\\2= / Uut+T]{'r)dT = / U {T)dT 

JO Jt 

Hence, 

rt+T rt+T 

J yl{r)dT < \\H,{s)\\l J u\T)dT (4.8.15) 



It Jt 

To evaluate the second term in (4.8.14), we write 



2/i(t) = /ii(t) *U[o.t)(r) = / /ii(t - fj)u[o,t)(cr)(if7 

Jo 

Jq hi{T — a)u{a)da if t < t 

Jq hi{T — a)u{a)da if t > t 

where hi{t) is the impulse response of Hi{s). Because -ffi(s) is a strictly proper 
stable transfer function, |/ii(r — (t)\ < aie^'^^^'^^"'' for some constants ai,a2 > 0, 
then using the Schwartz inequality and the boundedness of u{t), we have 

t + T rt + T / rt \ 2 

y\{T)dT = I I / hi{T — a)u{(7)d(y \ dr 

< I ( I \hi{T-(7)\da I \hi{T-a)\u'^{a)dajdT 



< a' 



t+T / i-t i-t 



il e-°'^^''-''U(T f e-°'^^-'-''^u^{a)da] dr 



< d^ r\-^»^ir-t,dr 
ai Jt 

otia 



< ^ (4.8.16) 



lai, 
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where a = sup^ru'^ {u) . Using (4.8.15) and (4.8.16) in (4.8.14) and defining fci 

o 2 - 



3{hl + ||i/i(s)||^), fc2 = ^, it follows that 



t+T i-t+T 

y'^{T)dT < fcl / U^{T)dT + ^2 



Jt 
and the first part of the Lemma is proved. 



If H{s) is strictly proper, then h^ = 0, Hx{s) = H{s) and fci = 3||-ff(s)||^, 
therefore the proof is complete. □ 



Lemma 4.8.3 (Properties of PE Signals) If w : TZ'^ i-^ 7?," is PE and w e £007 
then the following results hold: 

(i) Wi = Fw, where F G 7^™^" with m < n is a constant matrix, is PE if and 

only if F is of rank m. 
(ii) Let (a) e G £2 or (h) e G £00 (^nd e ^ as t —> 00, then W2 = w + e is PE. 

(iii) Let e G S{fi) and e G Coo- There exists a 11* > such that for all /i G [0,/i*), 
ujfj^ = Lu + e is PE. 

(iv) // in addition w G £00 o-nd H{s) is a stable, minimum phase, proper rational 
transfer function, then W3 = H{s)w is PE. 

Proof The proof of (i) and (iii) is quite trivial, and is left as an exercise for the 
reader. 

To prove (iv), we need to establish that the inequality 

f32T > J {q^w^{T)fdT > /3iT (4.8.17) 

holds for some constants (3i,f32,T > 0, any t>0 and any q G 7^" with |g| = 1. 

The existence of an upper bound in (4.8.17) is implied by the assumptions that 
w G £001 H{s) has stable poles and therefore lu^ G C^c- To establish the lower 
bound, we define 

A a^ j- 



and write 



(s + ay 



z{t) = -q'^H-\s)w3 = -H~\s)q'^W3 

^ ' {s^af ^ ' {s + af ^ ' 



where a > is arbitrary at this moment and r > is an integer that is chosen to be 
equal to the relative degree of -ff (s) so that , ° .,. H^^{s) is a proper stable transfer 
function. 

According to Lemma 4.8.2, we have 

rt+T pt+T 2 

z'^{T)dT<ki (q'^wsir)) dr + k2 
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for any t,T > and some fci, fc2 > which may depend on a, or equivalently 



t+T 



{q^Ws{T)fdT >y[] ^'(^)'^^ - ^2 



t+T 



(4.8.18) 



On the other hand, we have 
z{t) - 



q w 



{s + aY 

T f O,^ - {s + aY \ T 



s{s + ay 



q^w + zi 



where 



a'- - (s + ay -r . 
^1 = —7-^-^:^—1 w 



s{s + a) 
It is shown in Appendix A (see Lemma A. 2) that 

a''- {s + ay 



s{s + ay 

for some constant A; > that is independent of a. Therefore, applying Lemma 4.8.2, 
we have 



t+T 



zl{T)dT < 



h '•*+^ 



a^ 



{q ' wydT + fes 



a^ 



where fca = Sfc^^fc^ = fcs sup^ jtjp and ^3 > is independent of a, and the second 
inequahty is obtained using the boundedness of w. Using the inequality {x + j/)^ > 



^x'^ — y"^ , we have 



t+T 



Z^{T)dT 



t+T 



{q'^w{T) + Zl{T)fdT 



> 



> 



t+T 



{q' wydT- 



t+T 



Zi {T)dT 



t+T 



{q' wydT- 



t 



(4.8.19) 



Because w is PE, i.e. 



t+To 



{q w) dr > aoTo 
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for some Tq, ao > and \/t > 0, we can divide the interval [t, t + T] into subintervals 
of length To and write 

ft+T JM)_ pt+iTa 



f-t + l 'HI f-t + llo 

/ {q'wfdT > Y, / (9^^ 

Jt j^i Jt + (i-l)T„ 



where no is the largest integer that satisfies riQ < Sr. From the definition of riQ, 
have no > -Sr — 1; therefore, we can establish the following inequality 



t+T / T \ 

[q^wfdT > ao f _ - 1 j To = ao(T - Tq) (4.8.20) 

Because the above analysis holds for any T > 0, we assume that T > Tq. Using 
(4.8.19) and (4.8.20) in (4.8.18), we have 

f^^^iq'w.fdr > l(^|l(T-To)-^T-fc3-fc. 



fei H 2 ay \ 2 



2 i^-i ^W^ + k3 + k2] } (4.8.21) 



Since (4.8.21) holds for any a,T > and 0:0,^4 are independent of a, we can first 
choose a to satisfy 

2 a2 - 4 



and then fix T so that 



for a fixed /3i > 0. It follows that 

ct+T 

{q'^W3{T)fdr > /3iT > 
and the lower bound in (4.8.17) is established. □ 

Lemma 4.8.4 Consider the system 

Yi = A,Yi - 3,4,'^ Y2 

Y2 = (4.8.22) 

yo = cjYi 

where Ac is a stable matrix, {Cc,Ac) is observable, and (f) G Ceo- If 4'f defined as 

<Pf = Cj{sI-Ac)-^Bc<P 
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satisfies 

I rt+T„ 

ail <— (Pf{T)<pJ{T)dT < a2l, Vt > (4.8.23) 

for some constants ai,a2,T() > 0, then (4-8.22) is UCO. 

Proof The UCO of (4.8.22) follows if we establish that the observability grammian 
Af{t, t + T) oi (4.8.22) defined as 

Af{t, t + T)= I $^(t, t)CC^^{T, t)dT 

where C = [CjO]^ satisfies 

(3I>J\f{t,t + T) > al 

for some constant a,f3 > 0, where $(i,io) is the state transition matrix of (4.8.22). 
The upper bound /3I follows from the boundedness of <l>(i,^o) that is implied by 
(j) G Coo and the fact that Ac is a stable matrix. The lower bound will follow if we 
establish the following inequality: 

t+T 

y',{T)dr>a{\Yi{t)\' + \Y2\') 
t 

where Y2 is independent of t due to Y2 = 0. From (4.8.22), we can write 

Voir) = CjYiir) = Cje^^^^-'^Y^it) - J'^ Cje^^^^-'^^ 3,4^'^ {a)daY2 

= yi{T) + y2{T) 

foraUr > t, where 2/i(r)= Cj e^'''^^''*'>Yi{t),y2{T) = - J[ Cj e^-^-'-'''>Bc(t>'^ {a)daY2. 
Using the inequalities (x + j/)^ > ^ — y'^ and {x + y)"^ ^ \ — ^"^ with x = yi,y = y2 
over the intervals [t,t + T ], [t + T ,t + T], respectively, we have 

t+T rt+T 2, ^ r-t+T 

t+T 2( ) ft+T 

"^dr- yl{r)dr (4.8.24) 

t+T' ^ Jt+T' 

for any < T < T. We now evaluate each term on the right-hand side of (4.8.24). 
Because Ar is a stable matrix, it follows that 



|?/i(r)|<feie-''^(^-*)|yi(i)| 
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for some fci,7i > 0, and, therefore, 

r\l{r)dr < ^e~'^^^' \Y,[t)\' (4.8.25) 

On the other hand, since [Cc, Ac) is observable, we have 

rt+T 



e 

t 



^"(*-^)aCje^^(*-^)dT>A;2/ 



for any T > Ti and some constants k2,Ti > 0. Hence, 



2/f(T)dT>fc2|yi(i)r (4.8.26) 

Using j/2(t) = —<PJ{t)Y2 and the fact that 

i-t+T 

a2niTf)I > / (j)f(j)rdT > noOfiTo/ 

Jt+T' 

where no,ni is the largest and smallest integer respectively that satisfy 

T -T' 

no < -^ — < ni 

i.e., no > '^^-^ — 1, f^l < "^^"^ + 1, we can establish the following inequalities sat- 
isfied by 1/2: 

rt+T 



^ yl{r)dT < a^Tof^ + ljlr^l' 



t 

t+T (t-T' \ 

yl{T)dT > aiTo 1 1^21' (4.8.27) 

t+T' V ^0 / 



Using (4.8.25), (4.8.26), (4.8.27) in (4.8.24), we have 



%^(r)dr>(^|-|^e-2-^^j|yi(t)p 

.(^(^-l)-..Tog.l)),.2|^ (4.8.28) 

Because the inequality (4.8.28) is satisfied for all T^T with T > Ti, let us first 
choose T such that T > Ti and 

fc2 _ _fci_^_2^iT' > ^ 

2 271 - 4 
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Now choose T to satisfy 

aiTo I T — T 



T 



^l^lT-' -"'^"U^^ -* 



for a fixed /3i. We then have 

nt + T 



yl{T)dr>a{\Y,{t)\''+\Y^{t)[^ 



where a = min{pi,!f}. Hence, (4.8.22) is UCO. 



D 



4.8.2 Proof of Corollary 4.3.1 

Consider equations (4.3.30), (4.3.35), i.e.. 



e = AcC + Bc{-d^(p - enl) 
€ = Cje 



(4.8.29) 



that describe the stabihty properties of the adaptive law. In proving Theorem 4.3.1, 
we have also shown that the time derivative V of 



V 



e'Pr.e 



gT-p-l 



T-^e 



2 2 

where T = T^ > and P^ = Pj > 0, satisfies 

V < -u'e^ 
for some constant f > 0. Defining 



(4.8.30) 



A{t) 



A,-B,Cjnl -B.^)" 



c=[c] or, p 



T(t>Cj 

and X = [e^,0^]^, we rewrite (4.8.29) as 

X = A{t)x, e = C^x 
and express the above Lyapunov-like function V and its derivative V as 

V = x'^Px 

V = 2x^PAx + x^Px 



Pc 

r-i 



x'^iPA + A'^P + P)x < -V x^CC^x = -v e^ 



Bcn^s 



236 CHAPTER 4. ON-LINE PARAMETER ESTIMATION 

where P = 0. It therefore follows that P, as defined above, satisfies the inequality 

A^(i)P + PA{t) + v'CC'^ < O 

Using Theorem 3.4.8, we can establish that the equilibrium Cg = 0,6e = (i.e., 
Xe = 0) of (4.8.29) is u.a.s, equivalently e.s., provided {C\A) is a UCO pair. 

According to Lemma 4.8.1, {C,A) and {C,A + KC^) have the same UCO 
property, where 

is bounded. We can therefore establish that (4.8.29) is UCO by showing that 
{C, A + KC'^) is a UCO pair. We write the system corresponding to {CjA + KC'^) 
as 

Yi = A,Yi - B,4>'^Y2 

Y2 = (4.8.31) 

yo = CjYi 

Because (f> is PE and Cj [si — Ac)^^Bc is stable and minimum phase (which is 
implied by Cj [si — Ac)^^Bc being SPR) and (f) e Coo, it follows from Lemma 4.8.3 
(iii) that 

is also PE; therefore, there exist constants q;i,Q!2,7o > such that 

I rt+Ta 



a2l>7^ 4)f{T)4,J{T)dT > ail, yt>o 

Hence, applying Lemma 4.8.4 to the system (4.8.31), we conclude that {C,A + 
KC^) is UCO which implies that {C,A) is UCO. Therefore, we conclude that the 
equilibrium 0e = 0, eg = of (4.8.29) is e.s. in the large. D 



4.8.3 Proof of Theorem 4.3.2 (iii) 

The parameter error equation (4.3.53) may be written as 

~^ = M¥ _ (4.8.32) 

2/0 = c^{t)e 

where A(€) = — r^^,C^(i) = — — , yo = eJTi- The system (4.8.32) is analyzed 
using the Lyapunov-like function 
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that led to 

V = - ^" V =-e^m 



i^^'P)' 



along the solution of (4.8.32). We need to establish that the equilibrium ^e = of 
(4.8.32) is e.s. We achieve that by using Theorem 3.4.8 as follows: Let P = T^^, 
then V = ^^ and 

V = -9^[PA{t) + A'^{t)P + p]e = -Fc{t)c'^{t)e 

where P = 0. This implies that 

P + PA{t) + A^P + 2C{t)C'^{t) < 

and according to Theorem 3.4.8, ^e = is e.s. provided (C, A) is UCO. Using 
Lemma 4.8.1, we have that (C, A) is UCO if {C,A + KC^) is UCO for some K that 
satisfies the condition of Lemma 4.8.1. We choose 

K = -T — 
m 

leading to j4 + KC^ = 0. We consider the following system that corresponds to the 
pair (C,A+KC^), i.e., 

y = 



T,. <*'.. (4-8-33) 



The observability grammian of (4.8.33) is given by 



J^{t,t + T)= I 



m?{T) 



dT 



Because is PE and m > 1 is bounded, it follows immediately that the grammian 
matrix A/'(i, t + T) is positive definite for some T > and for all i > 0, which implies 
that (4.8.33) is UCO which in turn implies that {C,A) is UCO; thus, the proof is 
complete. □ 

In the following, we give an alternative proof of Theorem 4.3.2 (iii), which does 
not make use of the UCO property. 
From (4.3.54), we have 

V{t + T) = V{t) - r^ e^m^dT = V{t) - f^^ (^lilMl))!^^ (4.8.34) 

Jt Jt m^ 
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for any t,T > 0. Expressing d'^{T)<p{T) as ^^(t)(/)(t) = ^^(t)0(T) + {9{t) - 
0{tj)'^ <f){T) and using the inequality (a; + y)^ > i^x'^ — y'^, it follows that 



1 1 



t+T 



> — <; ^ / (e'^(i)0(T))'dr (4.8.35) 

where toq = supj>Qm^(t) is a constant. Because (/) is PE, i.e., 

ft+To 

(f>{T)^'^ {T)dT > aoToI 
t 

for some Tq and ao > 0, we have 

f "(F(i),^(r))'dT > aoToO'^ imt) 

> 2a„T„X;^\^{T-')V{t) (4.8.36) 

= 2aoTaX^,^{T)V{t) 

On the other hand, we can write 

'■- "' ^(a)0(^ ) 
m2(f7) 

and 



^(r) - e{t) = I ~e{<j)d(j = - / r \^/^; > (g)dg 



T 



- 'e'^{a)cl>{a)Tcj,{a) 



{e{T)-e{t))'<P{r) = -/ I ^ ^;;; "^ M 0(r)da 

'•^ r(a)(^(^) </.T(r)r(^(^) 



re'ia)H.)rir)TH<^)^^ (4.8.37) 

7t m(cr) m(f7) 



Noting that tti > 1, it follows from (4.8.37) and the Schwartz inequality that 
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where f3 = sup^>Q |<?!>(t)|. Changing the sequence of integration, we have 
" >>)-0'(i))^0(T))'dr 



2 Jt m2(a) 



< ^-wv^;^o I y^LA^^^n^da (4.8.38) 



Using (4.8.36) and (4.8.38) in (4.8.35) with T = Tq we have 



Jt m?{T) ~ Too 

P^n\l,,{T) /•*+^" (r(a)0(a))^ 



da 



2to,o Jt TV? [a] 

which imphes 

*+^" (^(tMt))^ 1 aoToA^„,(r) 

m'^(T) I I P -'o-^max(J-) Too 

2Tno 

= 7iT^(i) (4.8.39) 

where 71 = „ '^".."iS'-^rxs ^^l^^ ■ Using (4.8.39) in (4.8.34) with T = Tq, it follows that 

V{t + To) < V{t) - jiV{t) = -/V{t) (4.8.40) 

where 7 = 1 — 71. Because 71 > and V{t + Tq) > 0, we have < 7 < 1. Because 
(4.8.40) holds for all i > 0, we can take t = {n — l)To and use (4.8.40) successively 
to obtain 

V{t) < V{nTo) < 7"V"(0), Vi > hTq, n = 0, 1, . . . 

Hence, V{t) — > as t — > c» exponentially fast which implies that 6{t) — > as i — > cxd 
exponentially fast. □ 



4.8.4 Proof of Theorem 4.3.3 (iv) 

In proving Theorem 4.3.3 (i) to (iii), we have shown that (see equation (4.3.64)) 

v{t) = -e^{t)R{t)e{t) 
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where V = 2— ^ — -. From equation (4.3.60), we have 



-0it^r)Hl}£ill 



R{t)= / e-^^'--^ -- 7 ' dr 
Jo m^iV 



Because (j) is PE and m is bounded, we have 

Jt-Ta m^{T) Jo w2(r) 



Jt-To 

for any i > Tq, where (ii = aoagTo, Oq = supj — irr and ao,7o > s-re constants 
given by (4.3.40) in the definition of PE. Therefore, 

for t > To, which implies that V{t) satisfies 

V{t) < e""(*-'^"V(To), t > To 

where a = 2f3ie~^'^" XminO^) ■ Thus, V{t) ^ as i ^ c» exponentially fast with a 
rate equal to a. Using ^y2\min{^)V < |^| < \/'^^max{r)V, we have that 

\m\ < V2A™a.(r)y(To)e-t(*-^o) < / Wn |^-(j.^)|g-t(*-T„)^ ^ > j.^ 

Thus, d{t) —> 9* exponentially fast with a rate of |^ as i ^ c». Furthermore, for 
r = 7/, a = 2(3i'^e~^'^" and the rate of convergence (a/2) can be made large by 
increasing the value of the adaptive gain. D 



4.8.5 Proof of Theorem 4.3.4 (iv) 

In proving Theorem 4.3.4 (i) to (iii), we have shown that 9{t) satisfies the following 
equation 

m = P{t)p,-'e{o) 

We now show that P{t) ^ as f ^ 00 when (f) satisfies the PE assumption. 
Because P~^ satisfies 

d ^_i ^ U'^ 
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using the condition that <f) is PE, i.e., J " (J){t)<P^ {T)dT > aoToI for some constant 
ao, To > 0, it follows that 



Jo m^ m \Ta J 



aoToI 



m 

where m = swp^{m^{t)} and tiq is the largest integer that satisfies no < ijr, i.e., 
no > iji — 1. Therefore, 

p-\t) > p-\o)+(^-i)'^i 

\To J m 
> (^-l)'^I, W>To 
which, in turn, implies that 

P{t) < ((y ~ '^) °'"'^") '^^' ^^>^o (^•^•^^) 

Because P{t) > for all i > and the right-hand side of (4.8.41) goes to zero as 
t^ oo,we can conclude that P{t) ^ as i ^ oo. Hence, e{t) = P{t)Po^9{0) -^ 

as i — > cxD. D 



4.8.6 Proof of Corollary 4.3.2 

Let us denote T = P^^{t), then from (4.3.78) we have 

t=-l3T+^, r(0) = r^(0) = To = Po"' 



m^ 



'0 



-0(t-r) HrH'^{r) 







T{t) = e-^'To + [ 
Jo 

Using the condition that (j){t) is PE and m G Coo, we can show that for all t > Tq 

t-To »" Jo m 

> e-0^"^^I (4.8.42) 

m 

where ffi = supj m^(t). For t < Tq, we have 

r(t) > e-^*ro > e'^^'To > X^rmniTo)e~^^" I (4.8.43) 
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Conditions (4.8.42), (4.8.43) imply that 

r{t) > 7i/ 



(4.8.44) 



for alH > where 71 = min{^^, A™„(ro)}e"'''^<'. 

On the other hand, using the boundedness of (j), we can estabhsh that for some 
constant /32 > 



r(i) < To + 132 e-f'^'-^Url 
Jo 

< A„,,(ro)/+^/<72/ 



(4.8.45) 



where 72 = A„Q^(ro) + ^ > 0. 

Combining (4.8.44) and (4.8.45), we conclude 

111 < T{t) < 72/ 
for some 71 > 0,72 > 0. Therefore, 

12'! < P{t) < Ji'l 

and consequently P{t), P^^{t) G Ccc- Because P{t), P^^{t) G Ccc, the exponential 
convergence of 9 to 6* can be proved using exactly the same procedure and argu- 
ments as in the proof of Theorem 4.3.2. D 



4.8.7 Proof of Theorem 4.5.1 (iii) 

Consider the following differential equations which describe the behavior of the 
adaptive law (see (4.5.6) and (4.5.7)): 



e = AcC + Bc{-p*0'^4> -pi- enl) 
9 = Te4>sgn{p*) 
P = l<^i 
e = Cje 



(4.8.46) 



Because ^,p G C^o and ^ G £21 we can treat ^,p as external input functions and 
write (4.8.46) as 

Xa = AaXa + Ba{-pO (4.8.47) 



where 



IB.CJ -p*B,^'^ 
Tsgn{p*)<j)Cj 



^c ~ l^s^c^c 



Br, 



Be 
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In proving Corollary 4.3.1, we have shown that when cf> is PE and 4't4> & >Coo, the 
system x = AaX is e.s. Therefore, the state transition matrix <&„(<, to) of (4.8.47) 
satisfies 

||$a(i,0)||<aoe^^"* (4.8.48) 

for some constants ao, 7o > 0, which together with —BaP^ G £2 imply that Xa{t) —> 
as t —> c». 

4.8.8 Proof of Theorem 4.6.1 (iii) 

From the proof of Theorem 4.6.1 (i) to (ii), we have the inequality (see (4.6.9)) 

V{k+1)--Vik) <~{2-T,Xm) I "" e^{T)m^{T)dT (4.8.49) 

Using inequality (4.8.49) consecutively, we have 

V{k + n)-V{k) < -{2-TsXm) f ^ e^{T)m^{T)dT 

Jtk 

"-1 /.tfc+i+i 



-0 " ifc+ 
for any integer n. We now write 



(2 - r,A„)^ f '^^^'e\T)m^{T)dT (4.8.50) 



e'{T)m'{r)dT = ^ 2rT^dT 

m^[T) 






2 

-dT 



m?{T) 
Using the inequality [x + y)"^ > -^x"^ — y"^, we write 

rtk+i+i 1 /-u+i+i (^J(/)(r) ) /■U+i+i((^fe+, -4)^'/'(t)) 

(4.8.51) 



Because (J){t) /m{T) is bounded, we denote c = sup -[/K and have 



2 



•m?{T) 
From the hybrid adaptive algorithm, we have 



dr < cTs\9k+i - Ok 



ftk + i 

dk+i-dk= I e{T)(f>{T)dT, i=l,2,...,n 
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therefore, using the Schwartz inequality and the boundedness of \(f){t)\/m{t), 

f-tk+i 

< ciTs I e^{T)m^{T)dT 

Jtk 

< ciTs / €^{T)m^{T)dT (4.8.52) 

Jtk 

Using the expression (4.8.52) in (4.8.51), we have 

tfc + i+l 1 ntk + i+i [Oi^(P{t)] ftk + n 

e\T)m\T)dT>- ^ \, / dT-c^iT^ / e\T)m\T)dT 

which leads to 

"^^ e^{T)m^{T)dT = XI / "^'^^ e^{T)m^{T)dT 

t i=0 •'tk + i 

«-l /^ /.t. + . + l {9j(f>{T)) .t. + „ 






2rp2 

or equivalently 



k I ^ZI^TZ^'^^^fc ^ c T^ / e (T)m (T)dT 



*'^" £2(r)m2(T)rfT > , \ ,^,, J I r^" ^^^^^drh (4.8.53) 

^^ ^^ - 2(1 + n(n - l)c2T2/2) '= 4 m2(T) ^ ^ 

Because (f) is PE and 1 < m < c», there exist constants aj^, a2 and Tq > such that 

/•*+^" (^(t)</)^(t) 
Jt m^ ~ 

for any t. Therefore, for any integer k, n where n satisfies nTs > To, we have 

ej r" 'l^^^^dre, > aMh > ^a; (4.8.54) 
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Using (4.8.53), (4.8.54) in (4.8.50), we obtain the following inequality: 

hold for any integer n with n > Tq/Ts- Condition (4.8.55) is equivalent to 

V{k + n) <-(V{k) 

with 

A (2 - Ts\m)ai ^ 

^~ A„(2 + n(n-l)c2T2) 

Therefore, 

V{kn) = V{{k-)n + n) < jV{{k - l)n) < -f^V{{k - 2)n) < ... < -/''V{0) 



Because < 7 < 1 and, therefore, ^77 < 1, (4.8.56) implies that \0kn\ —^ expo- 
nentially fast as i — > 00, which, together with the property of the hybrid adaptive 
algorithm (i.e., |^fc+i| < l^fel); implies that 6k converges to 9* exponentially fast and 
the proof is complete. 



4.9 Problems 

4.1 Consider the differential equation 



-ju^t 



given by (4.2.7) where 7 > 0. Show that a necessary and sufficient condition 
for 9(t) to converge to zero exponentially fast is that u{t) satisfies (4.2.11), 
i.e., 

i-t+To 

u {T)dT > aoTo 
' t 

for all t > and some constants aojTo > 0. (Hint: Show that 

for all t > ti and some a,7o > if and only if (4.2.11) is satisfied.) 
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4.2 Consider the second-order stable system 



an ai2 

021 



where x, u are available for measurement, u G C^c and an, ai2, a2i, 6i, 62 are 
unknown parameters. Design an on-line estimator to estimate the unknown 
parameters. Simulate your scheme using an = —0.25, ai2 = 3, a2i = —5, 61 = 
1,62 = 2.2 and u = Wsin2t. Repeat the simulation when u = Wsin2t + 
7cos3.6t. Comment on your results. 

4.3 Consider the nonlinear system 

X = aifi{x) + 02/2(2;) -I- bigi{x)u + b2g2{x)u 

where u,x G Ti} , fi,9i are known nonlinear functions of x and ai,hi are 
unknown constant parameters. The system is such that u G Coo implies 
X G Coo- If a;,u can be measured at each time, design an estimation scheme 
for estimating the unknown parameters on-line. 

4.4 Design and analyze an on-line estimation scheme for estimating 6* in (4.3.26) 

when L[s) is chosen so that W{s)L[s) is biproper and SPR. 

4.5 Design an on-line estimation scheme to estimate the coefficients of the numer- 

ator polynomial 

Z{s) = 
of the plant 

when the coefficients of R{s) 

Repeat the same problem when Z{s) is known and R{s) is unknown. 

4.6 Consider the cost function given by (4.3.51), i.e. 

which we like to minimize w.r.t. 9. Derive the nonrecursive algorithm 

provided (j)^ (f) 7^ by solving the equation V J(^) = 0. 

4.7 Show that ljq = Flo, where F G 7^™xn with m < n is a constant matrix and 

LO G Coo is PE, is PE if and only if F is of full rank. 



is"- 


Z{s) 


+ 




+ bis 


+ 


^'o 








s)- 


= s" -h a„_is" 


-1 


+ 


h 


fli 


s + 


flo 


are 


known 
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4.8 Show that if lu,lu G Coo, ^ is PE and either 

(a) e e £2 or 

(b) e G £00 and e{t) —> as t —> 00 

is satisfied, then ujq = uj + e is PE. 

4.9 Consider the mass-spring-damper system shown in Figure 4.11. 

y(t) 



Figure 4.11 The mass-spring-damper system for Problem 4.9. 

where /? is the damping coefficient, k is the spring constant, u is the external 
force, and y{t) is the displacement of the mass m resulting from the force u. 

(a) Verify that the equations of the motion that describe the dynamic be- 

havior of the system under small displacements are 

my + fSy + ky = u 

(b) Design a gradient algorithm to estimate the constants m, /?, k when y, u 

can be measured at each time t. 

(c) Repeat (b) for a least squares algorithm. 

(d) Simulate your algorithms in (b) and (c) on a digital computer by assum- 

ing that m = 20 kg, /? = 0.1 kg/sec, fc = 5 kg/sec and inputs u of your 
choice. 

(e) Repeat (d) when m = 20 kg for < f < 20 sec and m = 20(2 — 

g-o.oi(i-20)^ kg for t > 20sec. 

4.10 Consider the mass-spring-damper system shown in Figure 4.12. 

-►y2(t) I ►y,(t) 



m 



k 



Figure 4.12 The mass-spring-damper system for Problem 4.10. 



248 



CHAPTER 4. ON-LINE PARAMETER ESTIMATION 



(a) Verify that the equations of motion are given by 

k{yi - 2/2) = M 

Hvi -^2) =my2 + f3y2 

(b) If j/i, 2/2, M can be measured at each time t, design an on-line parameter 

estimator to estimate the constants fc, m and f3. 

(c) We have the a priori knowledge that 0</3<l,fc>0.1 and m > 

10. Modify your estimator in (b) to take advantage of this a priori 
knowledge. 

(d) Simulate your algorithm in (b) and (c) when (3 = 0.2 kg/sec, ?7i = 15 kg, 

fc = 2 kg/sec and u = 5 sm2t + 10.5 kg • m/sec^. 

4.11 Consider the block diagram of a steer-by-wire system of an automobile shown 
in Figure 4.13. 



+.(y-^ 


Go(s) 


e. 






Gi{s) 


e 




iJ 


















dp 



Figure 4.13 Block diagram of a steer-by-wire system for Problem 4.11. 



where r is the steering command in degrees, 9p is the pinion angle in degrees 
and 6 is the yaw rate in degree/sec. The transfer functions Gq{s),Gi{s) are 
of the form 



Go(s) 



«ot^o 



Gi(s 



s'^ + 2^aujos + LJ^{1 - ko) 
kiLul 



2^iuJis ■ 



where fcoj^Oj Co: ^ij^ii Ci ^-re functions of the speed of the vehicle. Assuming 



that r. 



j"pj' 



can be measured at each time t, do the following: 



(a) Design an on-line parameter estimator to estimate ki,LOi,S,i,i = 0,1 using 



the measurement of 6p,6,r. 



(b) Consider the values of the parameters shown in Table 4.6 at different 
speeds: 



Table 4.6 Parameter values for the SBW system 


Speed V 


fco 


UJf) 


Co 


fci 


Wi 


Ci 


30 mph 


0.81 


19.75 


0.31 


0.064 


14.0 


0.365 


60 mph 


0.77 


19.0 


0.27 


0.09 


13.5 


0.505 
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Assume that between speeds the parameters vary Unearly. Use these 
values to simulate and test your algorithm in (a) when 

(i) r = 10sin0.2t + 8 degrees and V = 20 mph. 

(ii) r = 5 degrees and the vehicle speeds up from V = 30 mph to 

y = 60 mph in 40 second with constant acceleration and remains 

at 60 mph for 10 second. 

4.12 Show that the hybrid adaptive law with projection presented in Section 4.6 
guarantees the same properties as the hybrid adaptive law without projection. 

4.13 Consider the equation of the motion of the mass-spring-damper system given 
in Problem 4.9, i.e., 

my + f3y + ky = u 

This system may be written in the form: 

y = P*{u-my-Py) 

where P* = k appears in a bilinear form with the other unknown parameters 
m, p. Use the adaptive law based on the bilinear parametric model to estimate 
p*,m,P when u,y are the only signals available for measurement. Because 
fc > 0, the sign of p* may be assumed known. Simulate your adaptive law 
using the numerical values given in (d) and (e) of Problem 4.9. 



Chapter 5 

Parameter Identifiers and 
Adaptive Observers 

5.1 Introduction 

In Chapter 4, we developed a wide class of on-line parameter estimation 
schemes for estimating the unknown parameter vector 9* that appears in 
certain general linear and bilinear parametric models. As shown in Chapter 
2, these models are parameterizations of LTI plants, as well as of some special 
classes of nonlinear plants. 

In this chapter we use the results of Chapter 4 to design parameter iden- 
tifiers and adaptive observers for stable LTI plants. We define parameter 
identifiers as the on-line estimation schemes that guarantee convergence of 
the estimated parameters to the unknown parameter values. The design of 
such schemes includes the selection of the plant input so that a certain signal 
vector (j), which contains the I/O measurements, is PE. As shown in Chapter 
4, the PE property of (j) guarantees convergence of the estimated parame- 
ters to the unknown parameter values. A significant part of Section 5.2 is 
devoted to the characterization of the class of plant inputs that guarantee 
the PE property of (p. The rest of Section 5.2 is devoted to the design of 
parameter identifiers for plants with full and partial state measurements. 

In Section 5.3 we consider the design of schemes that simultaneously 
estimate the plant state variables and parameters by processing the plant 
I/O measurements on-line. We refer to such schemes as adaptive observers. 
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The design of an adaptive observer is based on the combination of a state 
observer that could be used to estimate the state variables of a particular 
plant state-space representation with an on-line estimation scheme. The 
choice of the plant state-space representation is crucial for the design and 
stability analysis of the adaptive observer. We present several different plant 
state-space representations that we then use to design and analyze stable 
adaptive observers in Sections 5.3 to 5.5. In Section 5.6, we present all the 
lengthy proofs dealing with parameter convergence. 

The stability properties of the adaptive observers developed are based on 
the assumption that the plant is stable and the plant input is bounded. This 
assumption is relaxed in Chapter 7, where adaptive observers are combined 
with control laws to form adaptive control schemes for unknown and possibly 
unstable plants. 

5.2 Parameter Identifiers 

Consider the LTI plant represented by the vector differential equation 

x = Ax + Bu, x(0) = xo /K0 1^ 

y = C^x ^^-^-^^ 

where x £ TZ'^,u e 'R-'^,y £ "Z^™" and n > m. The elements of the plant 
input u are piecewise continuous, uniformly bounded functions of time. The 
plant parameters A e T?."^", B e TZ'^'^'^, C e T^"^™- are unknown constant 
matrices, and A is a stable matrix. We assume that the plant (5.2.1) is 
completely controllable and completely observable i.e., (5.2.1) is a minimal 
state-space representation of the plant. 

The objective of this section is to design on-line parameter estimation 
schemes that guarantee convergence of the estimated plant parameters to the 
true ones. We refer to this class of schemes as parameter identifiers. The 
plant parameters to be estimated are the constant matrices A, B, C in (5.2.1) 
or any other set of parameters in an equivalent plant parameterization. The 
design of a parameter identifier consists of two steps. 

In the first step we design an adaptive law for estimating the parameters 
of a convenient parameterization of the plant (5.2.1) by following any one of 
the procedures developed in Chapter 4. 
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In the second step, we select the input u so that the adaptive law designed 
in the first step guarantees that the estimated parameters converge to the 
true ones. 

As shown in Chapter 4, parameter convergence requires additional con- 
ditions on a signal vector cp that are independent of the type of the adaptive 
law employed. In general the signal vector (p is related to the plant input or 
external input command u through the equation 

<j) = H{s)u (5.2.2) 

where H{s) is some proper transfer matrix with stable poles. The objective 
of the second step is to choose the input u so that ip is PE, which, as shown 
in Chapter 4, guarantees convergence of the estimated parameters to their 
true values. 

Before we embark on the design of parameter identifiers, let us first 
characterize the class of input signals u that guarantee the PE property of 
the signal vector (p in (5.2.2). The relationship between </>, H{s) and the 
plant equation (5.2.1) will be explained in the sections to follow. 

5.2.1 Sufficiently Rich Signals 

Let us consider the first order plant 

y = -ay + bu, y(0) = yo 

or 

y=-^u (5.2.3) 

s + a 

where a > 0, b are unknown constants and y, u ^ Coo are measured at each 

time t. 

We would like to estimate a, b by properly processing the input/output 
data y, u. It is clear that for the estimation of a, b to be possible, the 
input/output data should contain sufficient information about a, b. 

For example, for u = the output 

y{t) = e-^'y, 

carries no information about the parameter b. If, in addition, yo = then 
y{t) = Vt > obviously carries no information about any one of the plant 
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parameters. If we now choose u = constant cq / 0, then 



y{t) = e "* (yo- -co) + -co 
V a J a 



carries sufficient information about a, h provided yo / aco/b. This informa- 
tion disappears exponentially fast, and at steady state 

b 

y ~ -Co 
a 

carries information about the zero frequency gain - of the plant only, which 
is not sufficient to determine a, b uniquely. 

Let us now choose u{t) = sinwoi for some uq > 0. The steady-state 
response of the plant (5.2.3) is given by 

y f» ^sin(a;ot + (f) 
where 

A=- ^ -= J^* (^ = (sgn(fe) - 1)90° - tan-i — (5.2.4) 

li^o + a\ ^^2 ^^2 a 

It is clear that measurements of the amplitude A and phase (p uniquely 
determine a, b by solving (5.2.4) for the unknown a, b. 

The above example demonstrates that for the on-line estimation of a, b 
to be possible, the input signal has to be chosen so that y(t) carries suffi- 
cient information about a, b. This conclusion is obviously independent of the 
method or scheme used to estimate a, b. 

Let us now consider an on-line estimation scheme for the ffist-order plant 
(5.2.3). For simplicity we assume that y is measured and write (5.2.3) in the 
familiar form of the linear parametric model 

z = e*^<t> 

where z = y,9* = [b, a]'^ , (p = [u, — y]^. 

Following the results of Chapter 4, we consider the following gradient 
algorithm for estimating 9* given in Table 4.2. 



Fee/), F = F^ > 
z — z, z = 9 



T^ (5.2.5) 
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where 6{t) is the estimate of 9* at time t and the normahzing signal m? = 1 
due to (/) e £oo- 

As we established in Chapter 4, (5.2.5) guarantees that e,9 E ^2(^^00, 
9 G Coo, and if u G £00 then e(t), 9(t) ^ as t ^ 00. If in addition (p is PE, 
i.e., it satisfies 



ail > 



1 rt+To 



T 



-Jt 



\T)dT > aol, Vt > 



(5.2.6) 



for some TQ,ao,ai > 0, then 9(t) -^ 9* exponentially fast. Because the 

vector (f> is given by 

1 
b_ 

s+a 

the convergence of 9(t) to 9* is guaranteed if we choose u so that (p is PE, 
i.e., it satisfies (5.2.6). Let us try the choices of input u considered earlier. 
For n = Co the vector (p at steady state is given by 



Co 

_6co 



which does not satisfy the right-hand-side inequality in (5.2.6) for any con- 
stant cq. Hence, for u = cq, (p cannot be PE and, therefore, 9{t) cannot be 
guaranteed to converge to 9* exponentially fast. This is not surprising since 
as we showed earlier, for u = cq, y{t) does not carry sufficient information 
about a, b at steady state. 

On the other hand, for u = sint we have that at steady state 



sint 
-Asin(t + ip) 



where A 



_H_ 



^ — 2) V — (sgn(fe) — 1)90° — tan~ -, which can be shown to 
satisfy (5.2.6). Therefore, for u = sint the signal vector <p carries sufficient 
information about a and b, <p is PE and 9{t) -^ 9* exponentially fast. 

We say that u = sint is sufficiently rich for identifying the plant (5.2.3), 
i.e., it contains a sufficient number of frequencies to excite all the modes of 
the plant. Because u = cq 7^ can excite only the zero frequency gain of the 
plant, it is not sufficiently rich for the plant (5.2.3). 
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Let us consider the second order plant 

^l^ + ^O ^, ^ /c; OVA 

y = ^- , u = G{s)u (5.2.7 

s^ + ais + ao 

where ai,ao > and G(s) has no zero-pole cancellations. We can show 
that for u = sinLJot, y{t) at steady state does not carry sufficient infor- 
mation to be able to uniquely determine ai,ao,bi,bo. On the other hand, 
u(t) = sinojo^ + sincJit where ujq / uji leads to the steady-state response 

y{t) = Aq sm{uJot + (fo) + Ai s'm{ujit + (pi) 

where Aq =\ G{juJo) \,'^o = ^G{juJo),Ai =\ G{jui) \,ipi = ZG(ja;i). By 
measuring ^o>^i> 9^0) V?! we can determine uniquely ai,ao,&i,6o by solving 
four algebraic equations. 

Because each frequency in u contributes two equations, we can argue that 
the number of frequencies that u should contain, in general, is proportional 
to the number of unknown plant parameters to be estimated. 

We are now in a position to give the following definition of sufficiently 
rich signals. 

Definition 5.2.1 A signal u : TZ'^ -^ TZ is called sufficiently ricli of order 
n if it consists of at least ^ distinct frequencies. 

For example, the input 

m 

w = yj Aj sin Wjt (5.2.8) 

i=l 

where m > n/2, Ai y^ are constants and uJi ^ uj^ for i 7^ fc is sufficiently 
rich of order n. 

A more general definition of sufficient richness that includes signals that 
are not necessarily equal to a sum of sinusoids is presented in [201] and is 
given below. 

Definition 5.2.2 A signal u : TZ~^ -^ TZ" is said to be stationary if the 

following limit exists uniformly in to 

1 /•*«+^ -r 

Ruit) = lim - / u{t)u ' (t + T)dT 
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The matrix Ru^t) e j^nxn jg called the autocovariance of u. i?u(t) is a 
positive semidefinite matrix and its Fourier transform given by 



/oo 
e-^^-Ru{T)dT 
-oo 



is referred to as the spectral measure of u. If u has a sinusoidal component at 
frequency wq then u is said to have a spectral line at frequency wq and ^^(a;) 
has a ]3oint mass (a delta function) at ujq and — wq- Given 5u(lo'), i?u(i) can 
be calculated using the inverse Fourier transform, i.e., 

1 l-OO 

Furthermore, we have 

fOO 

Su{yj)duj = 2-kRu(0) 

For further details about the properties of Ru{t)-, Su^uj), the reader is referred 
to [186, 201]. 

Definition 5.2.3 A stationary signal u : TZ'^ -^ TZ is called sufficiently 

rich of order n, if the support of the spectral measure 5„(a;) of u contains 
at least n points. 

Definition 5.2.3 covers a wider class of signals that includes those specified 
by Definition 5.2.1. For example, the input (5.2.8) has a spectral measure 
with 2m points of support, i.e., at uii, —uJi for i = 1, 2, ... m, where m > n/2, 
and is, therefore, sufficiently rich of order n. 

Let us now consider the equation 

<j) = H{s)u (5.2.9) 

where H{s) is a proper transfer matrix with stable poles and (p G TV^. The 
PE property of (j) is related to the sufficient richness of u by the following 
theorem given in [201]. 

Theorem 5.2.1 Let u : TZ'^ >-^ TZ be stationary and assume that H{juii), 
. . ., H(juJn) are linearly independent on C" for all uji,t02, ■ ■ ■ ,uJn ^ T^, where 
^i / ^k for i ^ k. Then cp is PE if, and only if u is sufficiently rich of 
order n. 
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The proof of Theorem 5.2.1 is given in Section 5.6. 

The notion of persistence of excitation of the vector (j) and richness of the 
input u attracted the interest of several researchers in the 1960s and 1970s 
who gave various interpretations to the properties of PE and sufficiently 
rich signals. The reader is referred to [1, 171, 201, 209, 242] for further 
information on the subject. 

Roughly speaking, if n has at least one distinct frequency component for 
each two unknown parameters, then it is sufficiently rich. For example, if 
the number of unknown parameters is n, then m > ^ distinct frequencies 
in u are sufficient for u to qualify as being sufficiently rich of order n. Of 
course, these statements are valid provided H(jlji), . . . , H(juJn) with tOi / tOk 
are linearly independent on C" for all tUi (^ TZ,i = 1,2, ... , n. The vectors 
H{juJi),i = 1,2, ... ,n may become linearly dependent at some frequencies 
in TZ under certain conditions such as the one illustrated by the following 
example where zeros of the plant are part of the internal model of u. 

Example 5.2.1 Let us consider the following plant: 

where feg is the only unknown parameter. Following the procedure of Chapter 2, we 
rewrite the plant in the form of the linear parametric model 

where 9* = bo is the unknown parameter and 

s2+ 1 

(t> = H{s)u, H{s) 



(s + 2)3 

According to Theorem 5.2.1, we first need to check the linear independence of 
H{juJi), . . . ,H{juJn). For n = 1 this condition becomes H{juj) ^ 0,\/lu G TZ. It is 
clear that for uj = I, H{j) = 0, and, therefore, (j) may not be PE if we simply choose 
u to be sufficiently rich of order 1. That is, for u = smt, the steady-state values of 
(j), y are equal to zero and, therefore, carry no information about the unknown 69. 
We should note, however, that for u = svau)t and any w 7^ 1, 0, is PE. V 



Remark 5.2.1 The above example demonstrates that the condition for the 
linear independence of the vectors H(juJi), i = 1, 2, • • • , n on C" is suf- 
ficient to guarantee that (p is PE when u is sufficiently rich of order n. 
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It also demonstrates that when the plant is partially known, the input 
u does not have to be sufficiently rich of order n where n is the order of 
the plant. In this case, the condition on n can be relaxed, depending 
on the number of the unknown parameters. For further details on the 
problem of prior information and persistent of excitation, the reader 
is referred to [35]. 

In the following sections we use Theorem 5.2.1 to design the input signal 
u for a wide class of parameter estimators developed in Chapter 4. 

5.2.2 Parameter Identifiers with Full-State Measurements 

Let us consider the plant 

x = Ax + Bu, x(0)=xo (5.2.10) 

where C^ = I , i.e., the state x £ 7Z"' is available for measurement and A, B 
are constant matrices with unknown elements that we like to identify. We 
assume that A is stable and u G £oo- 

As shown in Chapter 4, the following two types of parameter estimators 
may be used to estimate A, B from the measurements of x, u. 

Series- Parallel 

3: = AmX + {A - Am)x + Bu (5.2.11) 

A = 7ieix^, B = ^2(-iv^ 

where Am is a stable matrix chosen by the designer, ei = x — x, 71,72 > 
are the scalar adaptive gains. 

Parallel 

i = Ax + Bu (5.2.12) 

A = 7ieix^, B = 72eitt^ 

where ti = x — x and 71, 72 > are the scalar adaptive gains. 

As shown in Chapter 4, if A is a stable matrix and u e £00 then 
x,A^ B ^ Coo', 11^(011)11-^(^)11)^1 ^ -^2 n £00 and ei(t) and the elements 
of A{t), B{t) converge to zero as t ^ 00. 
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For the estimators (5.2.11) and (5.2.12) to become parameter identifiers, 
the input signal u has to be chosen so that A(t),B(t) converge to the un- 
known plant parameters A, B, respectively, as t ^ oo. 

For simplicity let us first consider the case where u is a scalar input, i.e., 
B eW^'K 

Theorem 5.2.2 Let (A, B) he a controllable pair. If the input u e TZ^ is suf- 
ficiently rich of order n + 1, then the estimates A,B generated by (5.2.11) or 
(5.2.12) converge exponentially fast to the unknown plant parameters A,B, 
respectively. 

The proof of Theorem 5.2.2 is quite long and is presented in Section 5.6. 

An example of a sufficiently rich input u for the estimators (5.2.11), 
(5.2.12) is the input 



y^ Ai sin uJit 



i=l 



for some constants Ai ^ and Wj / cok for i ^ k and for some integer 



m > 



n+l 



Example 5.2.2 Consider the second-order plant 

X = Ax + Bu 

where x = \xi. X2\^ , and the matrices A, B are unknown, and ^ is a stable matrix. 

the series-parallel parameter identifier is 



Using (5.2.11) with Ar. 
given by 







-1 



-1 
-1 



[x — x) -\- 



aii{t) ai2{t) 
a2i{t) a22{t) 



hit) 

[ hit) J 



where x = [a;i,a;2] and 



aik = {xi- Xi)xk, i = l,2; k=l,2 

hi = {xi - Xi)u, i = 1,2 



The input u is selected as 



M = 5 sin 2.5t -I- 6 sin 6. It 
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which has more frequencies than needed since it is sufficiently rich of order 4. An 
input with the least number of frequencies that is sufficiently rich for the plant 
considered is 

u = Cq + sinujQt 

for some cg 7^ and uq ^ 0. \J 

If u is a vector, i.e., u £ TZ'^jQ > 1 then the following theorem may be 
used to select u. 

Theorem 5.2.3 Let {A,B) be a controllable pair. If each element Ui,i = 
1,2, .. .q of u is sufficiently rich of order n + 1 and uncorrelated, i.e., each Ui 
contains different frequencies, then A{t),B{t) converge to A,B, respectively, 
exponentially fast. 

The proof of Theorem 5.2.3 is similar to that for Theorem 5.2.2, and is 
given in Section 5.6. 

The controllability of the pair {A, B) is critical for the results of The- 
orems 5.2.2 and 5.2.3 to hold. If {A,B) is not a controllable pair, then 
the elements of {A, B) that correspond to the uncontrollable part cannot be 
learned from the output response because the uncontrollable parts decay to 
zero exponentially fast and are not affected by the input u. 

The complexity of the parameter identifier may be reduced if some of 
the elements of the matrices {A, B) are known. In this case, the order of 
the adaptive law can be reduced to be equal to the number of the unknown 
parameters. In addition, the input u may not have to be sufficiently rich of 
order n + 1. The details of the design and analysis of such schemes are left 
as exercises for the reader and are included in the problem section. 

In the following section we extend the results of Theorem 5.2.2 to the case 
where only the output of the plant, rather than the full state, is available 
for measurement. 

5.2.3 Parameter Identifiers with Partial-State Measurements 

In this section we concentrate on the SISO plant 

X = Ax + Bu, x(0)=xo (5.2.13) 

y = C^x 
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where A is a stable matrix, and y,u ^ TZ^ are the only signals available for 
measurement. 

Equation (5.2.13) may be also written as 

y = C^(sl - A)-^Bu + C^{sl - A)-^xo (5.2.14) 

where, because of the stability of A, tt = C~^{C^ {si — ^)~^}xo is an expo- 
nentially decaying to zero term. We would like to design an on-line parameter 
identifier to estimate the parameters A, B, C. The triple (A, B, C) contains 
n^ + 2n unknown parameters to be estimated using only input /output data. 
The I/O properties of the plant (5.2.14) at steady state (where tt = 0), how- 
ever, are uniquely determined by at most 2n parameters. These parameters 
correspond to the coefficients of the transfer function 

44 = C^isl - A)-^B = ^-^"' + ^-^^";" + • • • + ^° (5.2.15) 

where m < n — 1. 

Because there is an infinite number of triples (A,B,C) that give the same 
transfer function (5.2.15), the triple (A,B,C) associated with the specific 
or physical state space representation in (5.3.13) cannot be determined, in 
general, from input-output data. The best we can do in this case is to 
estimate the n + m + 1 < 2n coefficients of the plant transfer function 
(5.2.15) and try to calculate the corresponding triple {A,B,C) using some 
a priori knowledge about the structure of {A,B,C). For example, when 
{A, B, C) is in a canonical form, (A, B, C) can be uniquely determined from 
the coefficients of the transfer function by using the results of Chapter 2. In 
this section, we concentrate on identifying the n + m + 1 coefficients of the 
transfer function of the plant (5.2.13) rather than the v? + 2n parameters of 
the triple {A,B,C). 

The ffist step in the design of the parameter identifier is to develop 
an adaptive law that generates estimates for the unknown plant parameter 
vector 

0* = [bmi bm-l, ■ ■ ■ ,bo, an-l,an-2, • • • , , Oo] 

that contains the coefficients of the plant transfer function. As we have 
shown in Section 2.4.1, the vector 9* satisfies the plant parametric equation 

z = e*^(f) + et (5.2.16) 
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where 



Ms) 



Qm(g) ««-l(g) 

A(.)^' A(.) y 



C^adiisI - A) 



xo, ai{s) 



\s\s'-\ 



...,1] 



and A(s) is an arbitrary nionic Hurwitz polynomial of degree n. 

Using (5.2.16), we can select any one of the adaptive laws presented in 
Tables 4.2, 4.3, and 4.5 of Chapter 4 to estimate 9* . As an example, consider 
the gradient algorithm 



Te4> 

z — z, z 



(5.2.17) 



where T = F^ > is the adaptive gain matrix, and 6 is the estimate of 0* 
at time t. The normalizing signal m^ in this case is chosen as m? = 1 due 

to (f) e Coo- 

The signal vector (j) and signal z may be generated by the state equation 

4>Q = Ae0o + lu, (^o(O) = 
01 = Po0O 



Ac02 - ly, <^2(0) = 



(5.2.18) 



y + X^(t>2 



where (/)o e 7e" , (/>! G 7^™+^ 02 e 7^" 

-AT 
A, 



In-l I 



1 





Po = [0(m+i)x(n-m-l) I Im+l\ ^ Tc-"^^ •'^", A 



An-1 
An-2 

Ao 
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li is the identity matrix of dimension i x i , O j x fc is a matrix of dimension ihy k 
with all elements equal to zero, and det(s/ — Ac) = A(s) = s" + A a„_i(s). 
When m = n — 1, the matrix Pq becomes the identity matrix of dimension 
n X n. 

The state equations (5.2.18) are developed by using the identity 

[Si Acj /- ^^^^ 

established in Chapter 2. 

The adaptive law (5.2.17) or any other one obtained from Tables 4.2 
and 4.3 in Chapter 4 guarantees that €,0,z £ C^o', ^,0 £ £-2 Ci Coo and 
e(t),6(t) ^ as t ^ cx) for any piecewise bounded input u. For these 
adaptive laws to become parameter identifiers, the input signal u has to be 
chosen to be sufficiently rich so that (p is PE, which in turn guarantees that 
the estimated parameters converge to the actual ones. 

Theorem 5.2.4 Assume that the plant transfer function in (5.2.15) has no 
zero-pole cancellations. If u is sufficiently rich of order n + m+1, then the 
adaptive law (5.2.17) or any other adaptive law from Tables J^.2, 4-3, o-nd 
4.5 of Chapter 4, based on the plant parametric model (5.2.16), guarantees 
that the estimated parameter vector 6{t) converges to 9* . With the exception 
of the pure least-squares algorithm in Table 4-3 where the convergence is 
asymptotic, all the other adaptive laws guarantee exponential convergence of 
6 to 6*. 

Proof In Chapter 4, we have established that 9{i) converges to 6* if the signal (j) 
is PE. Therefore we are left to show that (f) is PE if u is sufficiently rich of order 
n + m + 1 and the transfer function has no zero-pole cancellations. 
From the definition of (f), we can write 



and 



(j) = H{s)u 



His) = j^^[al{s),-a],_,G{.s)]'^ 



A{s)R{s) 



[al{s)R{s),-a],_,{s)Z{s)]'^ (5.2.19) 



264 



CHAPTER 5. IDENTIFIERS AND ADAPTIVE OBSERVERS 



-nW is the transfer function of the plant. We first show by contradic- 



i)} are hnearly independent in (;;"+'"+ 1 



where G{s) 

tion that {H{juji),H{juj2), . . . , H{jujn+m+ 

for any wi, . . . ,u)n+m+i £ Tl and uti ^ ujk,h k = 1, . . . ,n + m + 1. 

Let us assume that there exist cji,. . . ,LUn+m+i such that H{juji)^ . . . ,H{JLUn+m+d 
are hnearly dependent, that is, there exists a vector h = [c^, Cm-i , • • •, cq, 
d„_i, fi„_2, • • • , do]^ e C"+™+i such that 






H^ijuj. 



n+m+l ) 



h — On+m+l 



(5.2.20) 



where On+m+i is a zero vector of dimension n + m+l. Using the expression (5.2.19) 
for H{s), (5.2.20) can be written as 



1 



A{juj,)R{juji 
where 



[b{juJi)R{juj^) + a{juji)Z{juJi)] =0, i = 1, 2, . . . , n + m + 1 



6(s) = c„s" + c„„is™-i + --- 
a{s) = -d„_is""i - d„_2s""^ 



Co 



rfo 



Now consider the following polynomial: 



A 



f{s) = a{s)Z{s) + h{s)R{s) 

Because /(s) has degree of at most m + n and it vanishes at s 
m + 1 points, it must be identically equal to zero, that is 



juji.i = 1, 



a{s)Z{s) + b{s)R{s) = 



or equivalently 



G{s) 



Z{-s) 
R{s) 



6(£) 

a{s) 



(5.2.21) 



for all s. However, because a{s) has degree at most n — l, (5.2.21) implies that G{s) 
has at least one zero-pole cancellation, which contradicts the assumption of no zero- 
pole cancellation in G{s). Thus, we have proved that H{ju!i), i = I, . . . ,n + m + I 
are linearly independent for any Ui ^ ujk, i,k = I, . . . , n+m+l. It then follows from 
Theorem 5.2.1 and the assumption of u being sufficiently rich of order n + m+l 
that 4> is PE and therefore 6 converges to 6* . As shown in Chapter 4, the convergence 
of 9 to 6* is exponential for all the adaptive laws of Tables 4.2, 4.3, and 4.5 with 
the exception of the pure least-squares where the convergence is asymptotic. □ 
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An interesting question to ask at this stage is what happens to the pa- 
rameter estimates when u is sufficiently rich of order less than n + m + 1, 
i.e., when its spectrum Su{uj) is concentrated onfc<n + m-|-l points. 

Let us try to answer this question by considering the plant parametric 
equation (5.2.16) with et = 0, i.e., 

where H(s) is given by (5.2.19). 

The estimated value of z is given by 

z = e'^(l) = 9'^H(s)u 

The adaptive laws of Tables 4.2, 4.3, and 4.5 of Chapter 4 based on the 
parametric equation (5.2.16) guarantee that z(t) -^ z{t) as t ^ oo for any 
bounded input u. If u contains frequencies at Ci;i,a;2, • • • , w^, then as i ^ 
cx), z = 0^ H{,s)u becomes equal to z = 6*^ H{s)u at these frequencies. 
Therefore, as t ^ oo, 9 must satisfy the equation 

Q (i^i, • • • ,j^k) 9 = Q (jo^i, • • • , jwfc) e* 

where 

Q(jwi,...,iu;fc) = : 

isakxn + m + 1 matrix with k linearly independent row vectors. Hence, 

Q{ju;i,...,ju;k){e-e*) = 

which is satisfied for any 6 for which 9 — 9* is in the null space of Q. If 
A:<n-|-m-|-lit follows that the null space of Q contains points for which 
9^9*. This means that z can match z at k frequencies even when 9^9*. 
The following Theorem presented in [201] gives a similar result followed 
by a more rigorous proof. 

Theorem 5.2.5 (Partial Convergence) Assume that the plant transfer 
function in (5.2.15) has no zero-pole cancellations. If u is stationary, then 

lim RJid) (9(t) -9*) = 

where 9{t) is generated by (5.2.17) or any other adaptive law from Tables 
4.2, 4-3, and 4-5 of Chapter 4 based on the plant parametric model (5.2.16). 
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The proof of Theorem 5.2.5 is given in Section 5.6. 

Theorem 5.2.5 does not imply that 6(t) converges to a constant let alone 
to 9*. It does imply, however, that 6{t) = 6{t) — 0* converges to the null 
space of the autocovariance R^{0) of (j), which depends on H(s) and the 
spectrum of u. In fact it can be shown [201] that -^^(O) is related to the 
spectrum of u via the equation 

k 

i=l 

which indicates the dependence of the null space of R(j,{0) on the spectrum 
of the input u. 



Example 5.2.3 Consider the second order plant 



y 



bo 



-u 



s" + ais + flo 

where ai,ao > and bg 7^ are the unknown plant parameters. We first express 
the plant in the form of 

z = r^(/. 

where 9* = [bo,ai,ao\'^ ,z= j^y,(j)= [j^u,-jj^y\ and choose A(s) = (s + 2)^ 
Let us choose the pure least-squares algorithm from Table 4.3, i.e.. 



P 

e 



P, P(0)=po/ 



where 9 is the estimate of 9* and select po = 50. The signal vector (j) = [(fl ,(j)l 
is generated by the state equations 



4>o 

Z 



Ac(/'o + ^M 
[0 l](^o 

2/ +[4 4]02 



where A^ — 

10 

simulations that: (i) for u 



1 

5sint 



The reader can demonstrate via computer 

12sin3t, 9(t) ^ 0* a.s t ^ 00; (ii) for u = 
12 sin ^t, 0{t) ^ 9 a.s t ^ 00 where ^ is a constant vector that depends on the initial 
condition 6'(0). V 
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Remark 5.2.2 As illustrated with Example 5.2.3, one can choose any one 
of the adaptive laws presented in Tables 4.2, 4.3, and 4.5 to form pa- 
rameter identifiers. The complete proof of the stability properties of 
such parameter identifiers follows directly from the results of Chap- 
ter 4 and Theorem 5.2.4. The reader is asked to repeat some of the 
stability proofs of parameter identifiers with different adaptive laws in 
the problem section. 

5.3 Adaptive Observers 

Consider the LTI SISO plant 

X = Ax + Bu, x(0) = xo (5.3.1) 

y = C^x 

where x £ 7?-". We assume that n is a piecewise continuous and bounded 
function of time, and ^ is a stable matrix. In addition we assume that the 
plant is completely controllable and completely observable. 

The problem is to construct a scheme that estimates both the parame- 
ters of the plant, i.e., A,B,C as well as the state vector x using only I/O 
measurements. We refer to such a scheme as the adaptive observer. 

A good starting point for choosing the structure of the adaptive observer 
is the state observer, known as the Luenberger observer, used to estimate the 
state vector x of the plant (5.3.1) when the parameters A, B, C are known. 

5.3.1 The Luenberger Observer 

If the initial state vector xq is known, the estimate x of x in (5.3.1) may be 
generated by the state observer 

i = Ax + Bu, x(0) = xo (5.3.2) 

where x £ 7?-". Equations (5.3.1) and (5.3.2) imply that x(t) = x(t),Vt > 0. 
When Xo is unknown and ^ is a stable matrix, the following state observer 
may be used to generate the estimate x of x: 

X = Ax + Bu, x(0) = Xo (5.3.3) 
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In this case, the state observation error x 



X satisfies the equation 



Ax, 



x{0) = xo - xo 



which impHes that x{t) = e x{0). Because ^ is a stable matrix x{t) -^ 0, 
i.e., x(t) -^ x(t) as t ^ oo exponentially fast with a rate that depends on 
the location of the eigenvalues of A. The observers (5.3.2), (5.3.3) contain 
no feedback terms and are often referred to as open-loop observers. 

When xq is unknown and A is not a stable matrix, or A is stable but 
the state observation error is required to converge to zero faster than the 
rate with which || e || goes to zero, the following observer, known as the 
Luenberger observer, is used: 



X = Ax + Bu + K{y — ij), a;(0) = xq 
y = 



(5.3.4) 



C^x 



where K is a matrix to be chosen by the designer. In contrast to (5.3.2) and 
(5.3.3), the Luenberger observer (5.3.4) has a feedback term that depends 
on the output observation error y = y — y. 

The state observation error x = x — x for (5.3.4) satisfies 



(A 



KC^)x, 



x(0) = xo - xo 



(5.3.5) 



Because (C, A) is an observable pair, we can choose K so that A — KU ' is 
a stable matrix. In fact, the eigenvalues of ^ — KC , and, therefore, the 
rate of convergence of x{t) to zero can be arbitrarily chosen by designing K 
appropriately [95]. Therefore, it follows from (5.3.5) that x{t) -^ x{t) expo- 
nentially fast as t ^ oo, with a rate that depends on the matrix A — KC . 
This result is valid for any matrix A and any initial condition xq as long as 
(C, A) is an observable pair and A, C are known. 



Example 5.3.1 Consider the plant described by 



y = [i,o]x 

The Luenberger observer for estimating the state x is given by 

[y-y) 

"J L '^ J L ""^ . 

[l,0]i 



"-41' 
-4 


x + 


' 1 
3 


u + 


■ fcl ■ 

. ^2 . 
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where K = [ki, ^2] is chosen so that 



ki 
k2 



[1 0] 



fci 1 

fc2 



is a stable matrix. Let us assume that x{t) is required to converge to x(t) faster 
than e~^*. This requirement is achieved by choosing ki,k2 so that the eigenvalues 
of Aq are real and less than —5, i.e., we choose the desired eigenvalues of Aq to be 
Ai = —6, A2 = —8 and design fci, k2 so that 



det(s/ - Ao) = s^ + (4 + fci)s + 4 + fc2 = (s + 6)(s + 8) 



which gives 



fci = 10, k2 



44 



V 



5.3.2 The Adaptive Luenberger Observer 

Let us now consider the problem where both the state x and parameters 
A,B,C are to be estimated on-line simultaneously using an adaptive ob- 
server. 

A straightforward procedure for choosing the structure of the adaptive 
observer is to use the same equation as the Luenberger observer in (5.3.4), 
but replace the unknown parameters A,B,C with their estimates A,B,C, 
respectively, generated by some adaptive law. The problem we face with 
this procedure is the inability to estimate uniquely the n? + 2n parameters 
of A, B, C from input/output data. As explained in Section 5.2.3, the best we 
can do in this case is to estimate the n + m+1 < 2n parameters of the plant 
transfer function and use them to calculate A, B, C. These calculations, 
however, are not always possible because the mapping of the 2n estimated 
parameters of the transfer function to the n^ + 2n parameters of A, B, C 
is not unique unless {A,B,C) satisfies certain structural constraints. One 
such constraint is that {A,B,C) is in the observer form, i.e., the plant is 
represented as 



'■■ In- 



^p 



•i^ (y I Ur) IJj 



(5.3.6) 



y = [1 ... 0]xc 
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where Op = [a„_i, a„_2, . . . ao]"*" and bp = [bn-i, bn-2, • • • ^o]"*" ai'e vectors of 
dimension n and /„_! £ '7^("'~i)^("~i) is the identity matrix. The elements of 
ttp and bp are the coefficients of the denominator and numerator, respectively, 
of the transfer function 



uis) 



6„_1S" 1 + bn-2S 



n-2 



+ . . . + 6o 



S" + ttn-lS^ 1 + . . .ao 



(5.3.7) 



and can be estimated on-line from input/output data by using the techniques 
described in Chapter 4. 

Because both (5.3.1) and (5.3.6) represent the same plant, we can assume 
the plant representation (5.3.6) and estimate Xa instead of x. The disadvan- 
tage is that in a practical situation x may represent physical variables that 
are of interest, whereas Xa may be an artificial state variable. 

The adaptive observer for estimating the state x^ of (5.3.6) is motivated 
from the structure of the Luenberger observer (5.3.4) and is given by 



A{t)x + bp{t)u + K{t)iy 
[10... 0]x 



y) 



(5.3.. 



where x is the estimate of Xr 



A{t) 



Ln-l 



-dp{t) 



K{t) = a* - ap{t) 



a* e TV^ is chosen so that 



A* 



'n-l 







(5.3.9) 



is a stable matrix and ap{t) and bp{t) are the estimates of the vectors Op and 
bp, respectively, at time t. 

A wide class of adaptive laws may be used to generate ap{t) and bp{t) 
on-line. As an example, we can start with (5.3.7) to obtain as in Section 
2.4.1 the parametric model 

z = e*^(j) (5.3.10) 
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where 



A(.) 



a^_i(s) a„_i(s) 



Hs) 



Hs) 



Hs. 



-y = y+ X (j)2 



s" + A^a„_i(s) 



iT 



^7,'/'^ 



and 



9* = [bn-l,h 



'n-2, 



-l,an-2, • • • ,«o] 



is the parameter vector to be estimated and A(s) is a Hurwitz polynomial 
of degree n chosen by the designer. A state-space representation for (p and z 
may be obtained as in (5.2.18) by using the identity {si — Ac)~^l = "'^"A 
where (Ac, I) is in the controller canonical form and det(,s/ — Ac) = A(s). 

In view of (5.3.10), we can choose any adaptive law from Tables 4.2, 
4.3 and 4.5 of Chapter 4 to estimate 6* and, therefore, Op, bp on-line. We 
can form a wide class of adaptive observers by combining (5.3.8) with any 
adaptive law from Tables 4.2, 4.3 and 4.5 of Chapter 4 that is based on the 
parametric plant model (5.3.10). 

We illustrate the design of such adaptive observer by using the gradient 
algorithm of Table 4.2 (A) in Chapter 4 as the adaptive law. The main 
equations of the observer are summarized in Table 5.1. 

The stability properties of the class of adaptive observers formed by 
combining the observer equation (5.3.8) with an adaptive law from Tables 
4.2 and 4.3 of Chapter 4 are given by the following theorem. 

Theorem 5.3.1 An adaptive observer for the plant (5.3.6) formed by com- 
bining the observer equation (5.3.8) and any adaptive law based on the plant 
parametric model (5.3.10) obtained from Tables 4-2 and 4.3 of Chapter 4 
guarantees that 

(i) All signals are u.b. 

(ii) The output observation error y = y — y converges to zero as t ^ oo. 

(iii) // u is sufficiently rich of order 2n, then the state observation error 

X = Xa — X and parameter error 6 = — 9* converge to zero. The rate 
of convergence is exponential for all adaptive laws except for the pure 
least-squares where the convergence is asymptotic. 
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Table 5.1 Adapl 


.ive 


observer with 


gradient algorithm 






; In-l 




Plant 


Xa — 


-ttp : 

: 


Xa + hpU, Xa e TV^ 




y=[l,0...0]xa 






■In-l 




Observer 


x= 


-dp{t)-. ... 


x+hp{t)u+{a*-ap{t)){y-y) 




y=[l 0...0]x 




e = Te(l) 




e=[bj{t),a;{t 


-iT 


Adaptive law 




^, r = r^ > 

A(s) "' A(s) y 


T 




^- Ms)y 


Design variables 


a* is chosen so that A* in (5.3.9) is stable; m^ = 




1 or m^ = 1 + cf^cp; A(s) is a monic Hurwitz poly- 




nomial of degree n 



Proof (i) The adaptive laws of Tables 4.2 and 4.3 of Chapter 4 guarantee that 
e, em, G >C2n>Coo and 6' e £00 independent of the boundedness of u, y. Because u e 
£00 and the plant is stable, we have Xa, y,4>,m ^ Loo- Because of the boundedness 
of y, (j) we can also establish that e, em, — > as i — > 00 by showing that e G £00 
(which follows from 0,4) & Coo), which, together with e G £2, implies that e — > as 
t ^ 00 (see Lemma 3.2.5). Because m,(f) & £00, the convergence of em, 9 to zero 
follows. 

The proof of (i) is complete if we establish that x G Coo- We rewrite the observer 
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equation (5.3.8) in the form 

i; = A*x + bp{t)u + {A{t) - A*)Xa (5.3.11) 

Because = \bJ {t),al {t)\ ,u,Xa G Coo and A* is a stable matrix, it follows that 

X G Coo- Hence, the proof of (i) is complete. 

(ii) Let 
(5.3.6) that 



(ii) Let X = Xa — X he the state observation error. It follows from (5.3.11) 



X = A* X — bpU + ap-y, x{0) = Xa{0) — x{0) (5.3.12) 

where bp = bp — bp, dp = tip — ap. From (5.3.12), we obtain 

y = C^x(s) = C^{sl - A*)-\-bpU + hpy) + et 

where tt = C^^ \C^ {si — A*)^^} 5:(0) is an exponentially decaying to zero term. 
Because (C, A) is in the observer canonical form, we have 

r^f.r- 4*ri = "»-i(") = [g"-^g"-^...g,l] 

^ ' det{sI-A*) det{sI-A*) 

Letting A*(s) = det(s/ - A*), we have 

1 " 
V{s) = ^ s"^' \-K^iU + a„_iyj + et 

where 6^, di is the ith element of bp and dp, respectively, which may be written as 

^^""^ " A^ ^ 17^ [-^«-»w + an-^y] + et (5.3.13) 



where A(s) is the Hurwitz polynomial of degree n defined in (5.3.10). We now apply 
Lemma A.l (see Appendix A) for each term under the summation in (5.3.13) to 
obtain 



A(£) 

A*{s: 



E 



1=1 



u + a„„i-— -y 



'A(.s) ' " 'A(s 



-W„{s) {Wm{s)u) 6„_, + Wa^{s) {WUs)y) 5„-»J + £« (5.3.14) 

where the elements of Wci{s), Wbi{s) are strictly proper transfer functions with the 
same poles as A(s). Using the definition of (j) and parameter error 9 = 9 — 6*, we 
rewrite (5.3.14) as 

V = -^ I -'e'^fk + E ^"(*) (- {Wb^{s)u) 6„_, + {Wu{s)y) a„-^) i + et 
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Figure 5.1 General structure of the adaptive Luenberger observer. 



Because 6„_i,a„_i G £2 H £00 converge to zero as t ^ cxd, u,y E Coo and the 
elements of Wci{s),Wi,i{s) are strictly proper stable transfer functions, it follows 
from Corollary 3.3.1 that all the terms under the summation are in C2 H Coc and 
converge to zero as i ^ 00. Furthermore, from em'^ = z — z = —O'^cp, m G Coo, e G 
C2 n Coo and e(t) ^ as i ^ 0, we have that O'^ <f) (£ C2 d Coo converges to zero as 
t — > 00. Hence, y is the sum of an output of a proper stable transfer function whose 
input is in C2 and converges to zero as i ^ c» and the exponentially decaying to 
zero term e^. Therefore, y{t) ^ as i — > c». 

(iii) If (f) is PE, then we can establish, using the results of Chapter 4, that 
dp{t), bp{t) converge to zero. Hence, the input —bpU + dpy converges to zero, which, 
together with the stability of A* , implies that x{t) —> 0. With the exception of the 
pure least- squares, all the other adaptive laws guarantee that the convergence of 
bp, dp to zero is exponential, which implies that x also goes to zero exponentially 
fast . 

The PE property of (j) is established by using exactly the same steps as in the 
proof of Theorem 5.2.4. □ 



The general structure of the adaptive observer is shown in Figure 5.1. 

The only a priori knowledge assumed about the plant (5.3.1) is that it is 
completely observable and completely controllable and its order n is known. 
The knowledge of n is used to choose the order of the observer, whereas 
the observability of (C, A) is used to guarantee the existence of the state 
space representation of the plant in the observer form that in turn enables 
us to design a stable adaptive observer. The controllability of (A, B) is not 
needed for stability, but it is used together with the observability of (C, A) 
to establish that (f) is PE from the properties of the input u. 
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Theorem 5.3.1 shows that for the state Xa of the plant to be estimated 
exactly, the input has to be sufficiently rich of order 2n, which implies that 
the adaptive law has to be a parameter identifier. Even with the knowledge of 
the parameters Up, bp and of the state Xa, however, it is not in general possible 
to calculate the original state of the plant x because of the usual nonunique 
mapping from the coefficients of the transfer function to the parameters of 
the state space representation. 

Example 5.3.2 Let us consider the second order plant 



y 



—ai 1 
-ao 

[1,0] a; 



h 

bo 



where ai, oq, 6i, bo are the unknown parameters and u, y are the only signals avail- 
able for measurement. 

Using Table 5.1, the adaptive observer for estimating x, and the unknown pa- 
rameters are described as follows: The observer equation is given by 



-ai{t) 1 
-ao{t) 

[1,0] X 



hit) 

bo{t) 



9-ai{t) 
20-ao(i) 



[y-y) 



where the constants a^ = 9,aQ = 20 are selected so that A* 

eigenvalues at Ai = —5, A2 = —4. 

The adaptive law is designed by first selecting 

A(s) = {s + 2){s + 3) = s^ + 5s + 6 

and generating the information vector (f> = [(pj , (ffj]^ 



-a*o 



has 



and the signals 



= 


-5 -6 
1 


(/>! + 


1 




= 


■ -5 -6 ■ 
1 


Ct>2 + 


' -1 



z = 


y+[5,6]02 


z = 


bi,bo (pi + [ai,ao] (j)2 


e = 


z — z 







6i 




fli 




= TlE'/'l, 




h . 




. «2 
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The adaptive law is then given by 

r til 1 , 

= 72 £02 

The adaptive gains 71 , 72 > are usually chosen by trial and error using simulations 
in order to achieve a good rate of convergence. Small 71,72 may result in slow 
convergent rate whereas large 71 , 72 may make the differential equations "stiff" and 
difficult to solve numerically on a digital computer. 

In order for the parameters to converge to their true values, the plant input u 
is chosen to be sufficiently rich of order 4. One possible choice for u is 

u = Ai sin ioit + A2 sin uj2t 
for some constants Ai, A2 ^ and uji ^ UJ2. V 

5.3.3 Hybrid Adaptive Luenberger Observer 

The adaptive law for the adaptive observer presented in Table 5.1 can be 
replaced with a hybrid one without changing the stability properties of the 
observer in any significant way. The hybrid adaptive law updates the param- 
eter estimates only at specific instants of time t^, where tk is an unbounded 
monotonic sequence, and t^+i — tj. = Tg where Tg may be considered as the 
sampling period. 

The hybrid adaptive observer is developed by replacing the continuous- 
time adaptive law with the hybrid one given in Table 4.5 as shown in Table 
5.2. The combination of the discrete-time adaptive law with the continuous- 
time observer equation makes the overall system more difficult to analyze. 
The stability properties of the hybrid adaptive observer, however, are very 
similar to those of the continuous-time adaptive observer and are given by 
the following theorem. 

Theorem 5.3.2 The hybrid adaptive Luenberger observer presented in Ta- 
ble 5.2 guarantees that 

(i) All signals are u.b. 

(ii) The output observation error y = y — y converges to zero as t ^ c5o. 

(iii) Ifu is sufficiently rich of order 2n, then the state observation error x = 

Xa — X and parameter error 9k = Ok — 0* converge to zero exponentially 
fast. 
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Table 5.2 Hybrid adaptive Luenberger observer 



Plant 





: In-l 


Xq, 


-ttp-. 




'■■ 


y = [i 


0...0]u 



JL Q^ \ t/p (Jj If t/^ Q; t / v 



Observer 



-ak : 



Ln-l 







x+hku+ {a*-ak){y-y) 



y = [l,0,...,0]x 
xe'R'^\te[tk,tk+i),k = 0,l,... 



Hybrid 
adaptive law 



ek+i = 0k + r£^'eiT)<piT)dT 



z — z 



, z{t) = el(j){t), Vte [tk,tk+i) 



m 



1 + ach^d), a > 






"AR" 



-u 



^^=MI)y^^k=K,al 



Design variable 



a* is chosen so that A* in (5.3.9) is stable; A(s) is 
monic Hurwitz of degree n; Tg = t^+i ~ tk is the 
sampling period; T = T > 0, T^ are chosen so that 
2 - rsAmax(r) > 70 for some 70 > 



To prove Theorem 5.3.2 we need the following lemma: 
Lemma 5.3.1 Consider any piecewise constant function defined as 
f{t) = fk yte[kT,,{k + l)Ts), k = 0,l,.... 



A 



// the sequence {A/^} e £2 where A/^ = f^+i — fk, then there exists a 
continuous function f{t) such that |/ — /| e £2 and / e £2- 
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Proof The proof of Lemma 5.3.1 is constructive and rather simple. Consider the 
following linear interpolation: 

m = h + lh+l^A{t - kTs) Mt e [kTs, {k + i)r,) 



It is obvious that / has the following properties: (i) it is continuous; (ii) |/(t) — 

/(^)| < l/fc+i - fk\; (iii) / is piecewise continuous and \f{t)\ = ^|/fc+i - fk\ 
Mt G [kTs, (fc + l)T's). Therefore, using the assumption A/^ G (.2 we have 



and 



i.e., / e £2 



/ \m-f{t)?dt<nY,\Mk\''< 

•^0 fc=0 



\Kt)?dt<Y,\M, 



k\ < 00 



fe=0 



D 



Proof of Theorem 5.3.2 

(i) We have shown in Chapter 4 that the hybrid adaptive law given in Table 4.5 
guarantees that Ok ^ Iqo', e, £fn G 'Coo H ^2- Because u G £00 and the plant is stable, 
we have y, x^, 4>,m £ C^c- As we show in the proof of Theorem 5.3.1, we can write 
the observer equation in the form 



X = A*x + hkU + {Ak - A*)xa, Vi G [tfc, tfe+i) 
where A* is a stable matrix and 



(5.3.15) 





In^l ' 


-dk 










Because ak,bk G loo', Xa,u G Coc, it follows from (5.3.15) that x G Coo, and, 
therefore, all signals are u.b. 

(ii) Following the same procedure as in the proof of Theorem 5.3.1, we can 
express y = y — y as 



y = C^{sI-A*) \-bkU + dky) + €t 



(5.3.16) 



where e* is an exponentially decaying to zero term. 

From Lemma 5.3.1 and the properties of the hybrid adaptive law, i.e., 9k G /qo 
and l^fe+i — Ok\ ^ £2, we conclude that there exists a continuous piecewise vector 



5.4. ADAPTIVE OBSERVER WITH AUXILIARY INPUT 279 

function 6 such that \6{t) — 9k{t)\, 6 e Ceo H C2, where 9k{t) is the piecewise constant 
function defined by 6k{t) = 9k, Vi G [tk,tk+i). Therefore, we can write (5.3.16) as 

y = C^{sl - A*)-\-bu + -ay) + f{t) + e* (5.3.17) 

where 

f{t) = C^isI - A*)-^ ((6 - bk)u - (a - dk)y) 

Using Corollary 3.3.1, it follows from u,y €i C^o and \6 — 9^1 G Cccf]C2 that 
/ G £00 n ^2 and f{t) ^ as ^ ^ 00. 

Because now 9 has the same properties as those used in the continuous adaptive 
Luenberger observer, we can follow exactly the same procedure as in the proof 
of Theorem 5.3.1 to shown that the first term in (5.3.17) converges to zero and, 
therefore, y{t) — > as i — > c». 

(iii) We have established in the proof of Theorem 5.2.4 that when u is sufficiently 
rich of order 2n, (f> is PE. Using the PE property of (j) and Theorem 4.6.1 (iii) we 
have that 9^ — > 9* exponentially fast. □ 



5.4 Adaptive Observer with Auxiliary Input 

Another class of adaptive observers that attracted considerable interest [28, 
123, 172] involves the use of auxiliary signals in the observer equation. An 
observer that belongs to this class is described by the equation 

i = A{t)x + bp{t)u + K{t){y-y) + v, x(0) = xq 

y = [10...0]x (5.4.1) 

where x, A{t),bp{t), K{t) are as defined in (5.3.8), and v is an auxiliary vector 
input to be designed. The motivation for introducing v is to be able to 
use the SPR-Lyapunov design approach to generate the adaptive laws for 
A(t) , bp(t) , K (t) . This approach is different from the one taken in Section 
5.3 where the adaptive law is developed independently without considering 
the observer structure. 

The first step in the SPR-Lyapunov design approach is to obtain an error 
equation that relates the estimation or observation error with the parameter 
error as follows: By using the same steps as in the proof of Theorem 5.3.1, 
the state error x = Xa — x satisfies 

X = A*x + ttpy — bpU — V, x(0) = xq 
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y = C'^x (5.4.2) 

where ap,fep are the parameter errors. Equation (5.4.2) is not in the fa- 
miliar form studied in Chapter 4 that allows us to choose an appropriate 
Lyapunov-like function for designing an adaptive law and proving stability. 
The purpose of the signal vector v is to convert (5.4.2) into a form that is 
suitable for applying the Lyapunov approach studied in Chapter 4. The fol- 
lowing Lemma establishes the existence of a vector v that converts the error 
equation (5.4.2) into one that is suitable for applying the SPR-Lyapunov 
design approach. 

Lemma 5.4.1 There exists a signal vector v e TZ"^ , generated from mea- 
surements of known signals, for which the system (5.4-2) becomes 

e = A*e + Bci-e'^(p), e(0) = xq 

y = C^e (5.4.3) 

where C {si — A*)~'^Bc is SPR, (p £ "^^^ is a signal vector generated from 
input/output data, 9 = [ftj ,aJ] , and e £ 7Z^ is a new state vector. 

Proof Because {C,A*) is in the observer form, we have 

^ ^'^ ^> - A*{s) 

where q:„_i(s) = [s"^^,s"~^, . . . ,1]^, A*(s) = det{sl - A*). Therefore, (5.4.2) can 
be expressed in the form 

y = C'^isI - A*y'^ ^Upy-bpU- v^+et 

where e^ = C^^ {C^(s/ — A*)^^} Xq, A(s) = s"^^ + A^a„_2(s) is a Hurwitz poly- 
nomial, A^ = [A„_2, A„_3, . . . , Ai, Aq] is to be specified and a^, bi is the ith element 
of Up, bp respectively. 

Applying the Swapping Lemma A.l given in Appendix A to each term under 
the summation in (5.4.4), we obtain 

y = A^|Et«-A(^^-^-AR"j ('•'•') 

" . T / >! ^ 
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We now use Lemma A.l to obtain expressions for Wd, Whi in terms of the param- 
eters of A(s). Because Wcl^ Wbi are the transfer functions resulting from swapping 
with the transfer function 



a1_2{s)\ 



A(s) A{s) 

where Co = [1, 0, ... , 0]^ G W''^ 



1 - Cji-sl - Ao)-iA = 1 + Cj{.sl - Ao)-i(-A) 



In- 



Ao= _> : g7^(n-i)x(„-i) 



it follows from Lemma A.l that 

W,i{s) = -CjisI - Ao)-i = """rf ^^ , Wbi{s) = {si - Ao)-i(-A) 

A(s) 

Similarly Wd, Wbi i = 2, 3, . . . , n result from swapping with 

'^^=Cj{sI-Ao)-'d, 

where di = [0, . . . , 0, 1, 0, . . . , 0]^ G 7?.""^ has all its elements equal to zero except 
for the (i— l) — th element that is equal to one. Therefore it follows from Lemma A.l 
that 



Wc^{s) = -Cj {si - AoY 



«n-2('S) 
A(.) ^ 



i = 2,3, . . . ,n 



Wd{s) = {sI-Aoy^d,, z = 2,3,...,n 



If we define 



A 



u, . , , y 



A{s) "' A{s) 

and use the expressions for Wci{s),Wbi{s), (5.4.5) becomes 



y 



A*{s) 
A(s) 



-0' 



A{s[ 



-Vl 



n 

X] { [(*-^ ~ ^o^^diy] a„_i - [{sl - Aoy^d.u] 6„_j| + v 



where v is partitioned as w = [fi, v^]^ with vi G 7?,^ and w G 7?," ^ and di = —A 
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Choosing vi = and 

n 

w = - ^ I [{sl - Aoy'^d^y] hn-i - [{si - Ao)"^diw] K-i\ 



we obtain 

y=^(-^'^0) + £* (5.4.6) 

Because 



A(g) s" i + A^a„_2(g) al^i{s)bx -j , 

A*(s) A*(s) A*(s) 

where 6a = [1,A^]^ G 7e" and C = [1,0, ...,0]^ € 7e". For B^ = bx, (5.4.3) 
is a minimal state-space representation of (5.4.6). Because A(s) is arbitrary, its 
coefficient vector A can be chosen so that ^.fjx is SPR. The signal v is implementable 

because di,bi and u,y are available for measurement. □ 



We can now use (5.4.3) instead of (5.4.2) to develop an adaptive law for 
generating 9 = mJ, aJ . Using the results of Chapter 4, it follows that the 
adaptive law is given by 

9 = recf>, e = y = y-y (5.4.7) 

where T = T^ > 0. 

We summarize the main equations of the adaptive observer developed 
above in Table 5.3. The structure of the adaptive observer is shown in 
Figure 5.2. 

Theorem 5.4.1 The adaptive observer presented in Table 5.3 guarantees 
that for any bounded input signal u, 

(i) all signals are u.b. 

(ii) y{t) = y -y ^0 as t ^ oo. 

(iii) ap(t), hp{t) £ £2 H £00 oind converge to zero as t ^ 00. 

In addition, if u is sufficiently rich of order 2n, then 

(iv) x(t) = Xaif) — x(t), ap(t) = hpit) — ap, hp(t) = hp(t) — bp converge to 
zero exponentially fast. 
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Table 5.3 Adaptive observer with auxiliary input 



Plant 



I-n-l 

Xa + bpU, y = [1 0.. .0]xc 


flp = [o-n-l, • • • , Oo] 5 bp = [bn-1, • • • , ^o] 



Observer 





In-l 


-ap{t) 









10 ... 


0]x 



x+ hp(t)u+ {a*-ap{t) ) {y-y)+v 



Adaptive law 



r</)(y-y), r = rT>o 



A(s) ""' A(i)~y 



, ^=Er=i 



[iyi(s)y]a„_i + [iyi(s)u]6„- 



Auxiliary input 



Wi{s) = {sl - Ao)-U,, 
d^ = -X; dj= [0...0,1,0...0], , = 2,...,n 



An 



-A 


In-2 








A = [A„_2, . • • , Ao] 



det(s/ - Ao) = A(s) = s"-i + A ' a„_2(s) 



(i) a* is chosen such that A*- 



Design variables 



(ii) The vector A is chosen such that Aq is stable 



'n-l 







is stable 



and [10... 0]{sI-A*)-^ 



1 
A 



is SPR. 
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Parameter 
Estimator 



Plant 



Auxiliary 
Signal Generator 



Observer 
(Equation (5.4.1)) 



+ 



9-»> 



ap,h 



pj "p 



C^ 



Figure 5.2 Structure of the adaptive observer with auxiliary input signal. 

Proof The main equations that describe the stabihty properties of the adaptive 
observer are the error equation (5.4.3) that relates the parameter error with the 
state observation error and the adaptive law (5.4.7). Equations (5.4.3) and (5.4.7) 
are analyzed in Chapter 4 where it has been shown that e, y G C2 Hiloo and 6 G Coo 
for any signal vector (f) with piecewise continuous elements. Because u,y ^ Coo, it 
follows that (f) G Coo and from (5.4.3) and (5.4.7) that 0,e,y G Coo and 6 G £2. 
Using e,y G C2f]Coo together with e, y G £00, we have y{t) -^ 0, e{t) ^ as 
t — > 00, which implies that 6{t) — > as i — > 00. From (? G £2 ri Coo, it follows that 
V £ C2 r\Coo and v{t) —> as t —> c». Hence, all inputs to the state equation (5.4.2) 
are in £00, which implies that x G £00, i.e., x G £00. 

In Chapter 4 we established that ii (j),(j) G Coo and (j) is PE, then the error 
equations (5.4.3) and (5.4.7) guarantee that 6{t) ^ as i ^ c» exponentially fast. 
In our case 4>,4> & Coo and therefore if u is chosen so that (f) is PE then 6{t) ^ as 
i — > 00 exponentially fast, which implies that e{t),y{t),6{t),v{t),ap{t)y,bp{t)u and, 
therefore, x{t) converge to zero exponentially fast. To explore the PE property of 
(j), we note that (j) is related to u through the equation 



1 



A(s) 



q;„„i(s) 



Because u is sufficiently rich of order 2n, the PE property of (j) can be established 
by following exactly the same steps as in the proof of Theorem 5.2.4. □ 



The auxiliary signal vector v can be generated directly from the signals 
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(f) and 9, i.e., the filters Wi for y,u do not liave to be implemented. This 
simplification reduces the number of integrators required to generate (j), v 
considerably and it follows from the relationship 

{sI-Aor'd^ = Qi^^^^^, i = l,2,...,n 

where Qi e T^v""!)^!""!) are constant matrices whose elements depend on 
the coefficients of the numerator polynomials of (s/ — Ao)~^(ii (see Problem 
2.12). 

As with the adaptive Luenberger observer, the adaptive observer with 
auxiliary input shown in Table 5.3 requires the input u to be sufficiently 
rich of order 2n in order to guarantee exact plant state observation. The 
only difference between the two observers is that the adaptive Luenberger 
observer may employ any one of the adaptive laws given in Tables 4.2, 4.3, 
and 4.5 whereas the one with the auxiliary input given in Table 5.3 relies 
on the SPR-Lyapunov design approach only. It can be shown, however, (see 
Problem 5.16) by modifying the proof of Lemma 5.4.1 that the observation 
error y may be expressed in the form 

y = -e^(j) (5.4.8) 

by properly selecting the auxiliary input v and (f). Equation (5.4.8) is in the 
form of the error equation that appears in the case of the linear parametric 
model y = 6 (p ^-^d allows the use of any one of the adaptive laws of 
Table 4.2, 4.3, and 4.5 leading to a wide class of adaptive observers with 
auxiliary input. 

The following example illustrates the design of an adaptive observer with 
auxiliary input v and the generation of v from the signals (p, 6. 

Example 5.4.1 Let us consider the second order plant 



Xa = 


-ai 1 
-ao 


Xa + 


. ^0 


y = 


1 0]Xc, 







where Oi > 0,ao > 0, 6i,6o s-re unknown constants and y,u are the only available 
signals for measurement. 
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We use Table 5.3 to develop the adaptive observer for estimating Xa and the un- 
known plant parameters. We start with the design variables. We choose a* = [4,4]^, 
A = Ao, A(s) = s + Aq. Setting Aq = 3 we have 



[1 0][sI-AT' 



s + 3 



which is SPR. 

The signal vector 



where 



s+3 ' s+3 ' s+3y' s+ 
4> = [</'l>2,03,04] 

= M — 301, (/<i = — 301 + u 

= 01 

= -2/ + 303, 03 = -303 + 2/ 

= -03 



(s + 2)2 

-|T 

■T^yl is realized as follows 



with 0i(O) = 0,03(0) = 0. 

For simplicity we choose the adaptive gain T = diagjlO, 10, 10, 10}. The adap- 
tive law is given by 

bi = W(j)i{y-y), bo = W4>2{y - y) 

ai = W(j)3{y - y) , uq = W(p4{y - v) 




and the signal vector v 
3 



by 



y ai 



u hi 



1 



s + T 



^s-h3 / Vs + 3 

= 3ai03 - 36i0i - ao03 + ^o0i 

= lO(y-y)(-30304- 30102 + 0^ + 0^) 

The observer equation becomes 



y)ao + 



s-h3 



U bn 



-0,1 1 

-oo 


10 



4 - oi 
4-ao 



[y-y) 



{y - y) [-30304 - 30102 + 04 + 02 



The input signal is chosen as u = Ai smujit + A2 sin W2t for some Ai, A2 7^ and 

Wi 7^ W2- V 
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5.5 Adaptive Observers for Nonminimal Plant 
Models 

The adaptive observers presented in Sections 5.3 and 5.4 are suitable for 
estimating the states of a minimal state space realization of the plant that 
is expressed in the observer form. Simpler (in terms of the number of inte- 
grators required for implementation) adaptive observers may be constructed 
if the objective is to estimate the states of certain nonminimal state-space 
representations of the plant. Several such adaptive observers have been pre- 
sented in the literature over the years [103, 108, 120, 123, 130, 172], in this 
section we present only those that are based on the two nonminimal plant 
representations developed in Chapter 2 and shown in Figures 2.2 and 2.3. 

5.5.1 Adaptive Observer Based on Realization 1 

Following the plant parameterization shown in Figure 2.2, the plant (5.3.1) 
is represented in the state space form 

(/)i = Ac(^i + lu, 0i(O) = 

^2 = Ac^2-ly, 02(0) = 

ib = AcU>, ui(0) = ujQ = BqXq (5.5.1) 

r]o = Cjuj 

z = y + X^4>2 = 0*^4> + r]o 

y = e*^ (p - x^ (j)2 + m 

where to (En"',(p= [(f>J , (pj]^ , (pi e 7^'^, i = 1, 2; A^ e 7^"^" is a known stable 
matrix in the controller form; I = [1, 0, . . . , 0]^ G 7Z"' is a known vector such 
that {si - Ac)-H = ^^^^ and A(s) = det(s/ - Ae) = s" + A^a„_i(s), 

A = [A„_i, . . . , Ao]^; 0* = [bn-i, bn-2, ■■■,bo, a„_i, a„_2, . . • , ao]^ e 7^^" are 
the unknown parameters to be estimated; and Bq G -j^nxn jg ^ constant 
matrix defined in Section 2.4. 

The plant parameterization (5.5.1) is of order 3n and has 2n unknown 
parameters. The state to and signal rjQ decay to zero exponentially fast with 
a rate that depends on Ac. Because Ac is arbitrary, it can be chosen so that 
rio,uj go to zero faster than a certain given rate. Because 0i(O) = 02(0) = 0, 
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the states (pi, 4>2 can be reproduced by the observer 

(^1 = AJi + lu, 0i(O) = O 

(^2 = Ach-ly, 02(0) = (5.5.2) 

which imphes that (t>i{t) = (f)i{t), i = 1, 2 Vi > 0. The output of the observer 
is given by 

zo = e*^<p 

yo = e*'^ 4> - X^ 4>2 = 9*'^ (p - X^ ^2 (5.5.3) 

The state uj in (5.5.1) can not be reproduced exactly unless the initial 
condition xq and therefore loq is known. 

Equation (5.5.2) and (5.5.3) describe the nonminimal state observer for 
the plant (5.3.1) when 6* is known. Because 0(t) = <j){t),\/t > 0, it follows 

that the output observation errors Cz = z — zq, &o = y — Ho satisfy 

e^ = eo = ??o = C([e'^'=*a;o 

which implies that eo,e^ decay to zero exponentially fast. The eigenvalues 
of Ac can be regarded as the eigenvalues of the observer and can be assigned 
arbitrarily through the design of Ac. 

When 9* is unknown, the observer equation (5.5.2) remains the same but 
(5.5.3) becomes 

z = y + X^^2 

y = 9'^4>-X^4>2 (5.5.4) 

where 6{t) is the estimate of 9* at time t and 0(t) = (f>(t) is generated from 
(5.5.2). Because 9* satisfies the parametric model 

z = y + X^ 4>2 = 9*^ 4> + r]o (5.5.5) 

where z, (p are available for measurement and rjQ is exponentially decaying 
to zero, the estimate 9{t) of 9* may be generated using (5.5.5) and the 
results of Chapter 4. As shown in Chapter 4, the exponentially decaying to 
zero term 770 does not affect the properties of the adaptive laws developed 
for r^o = in (5.5.5). Therefore, for design purposes, we can assume that 
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rjQ =0 Vt > and select any one of the adaptive laws from Tables 4.2, 4.3, 
and 4.5 to generate 6{t). In the analysis, we include r/o / and verify that 
its presence does not affect the stability properties and steady state behavior 
of the adaptive observer. As an example, let us use Table 4.2 and choose 
the gradient algorithm 

9 = Te^, t = z — z = y — y (5.5.6) 

where V = r"*" > and (p = (f). 

Equations (5.5.2), (5.5.4) and (5.5.6) form the adaptive observer and are 
summarized in Table 5.4 and shown in Figure 5.3. 

The stability properties of the adaptive observer in Table 5.4 are given 
by the following theorem. 

Theorem 5.5.1 The adaptive observer for the nonminimal plant represen- 
tation (5.5.1) with the adaptive law based on the gradient algorithm or any 
other adaptive law from Tables 4-2, 4-3, and 4-5 that is based on the para- 
metric model (5.5.5) guarantees that 
(i) <^(t) = (j){t) Vt > 0. 
(ii) All signals are u.b. 
(iii) The output observation error t{t) = y{t) — y{t) converges to zero as 

t -^ oo. 
(iv) // u is sufficiently rich of order 2n, then 9(t) converges to 9*. The 

convergence of9{t) to 9* is exponential for all the adaptive laws of Tables 

4-2, 4-3, and 4-5 with the exception of the pure least squares where 

convergence is asymptotic. 

Proof (i) This proof follows directly from (5.5.1) and (5.5.2). 

(ii) Because (p = (p, the following properties of the adaptive laws can be es- 
tablished using the results of Chapter 4: (a) e,0 E Coo', (b) e,0 e >Coon'^2 for 
the continuous time adaptive laws and \Ok+i — Ok\ G ^2 for the hybrid one. From 
e,9,9 ^ Coo, u G Coo, the stability of Ac and the stability of the plant, we have that 
all signals are u.b. 

(iii) For the continuous-time adaptive laws, we have that 

e = z- z = y + \^<p2 - {y + \^4>2) = y-y 

We can verify that e G Coo which together with e G £2 imply that e{t) — > as 
t -^ 00. 
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Table 5.4 Adaptive observer (Realization 1) 



Plant 


4>i = Ac(pi + lu, (^i(O) = 
<j>2 = Ac<^2 - ly, MO) = 

OJ = AcUJ, i^{0) = U!o 

rjo = Cjuj 

z = y + \^<t)2 = 0*^(p + m 

y = e*^^ - X^(P2 + r/o 


Observer 


(f>i = Ac(i>i + lu, (^i(O) = 

^2 = Ac<^2 - ly, MO) = 
z = e^4> 

y = z - X^(t>2 


Adaptive law 


e = Te(f>, r = r^ > 

e = z-z, z = e'^(f> 


Design 

variables 


Ac is a stable matrix; (Ac, I) is in the controller form; 
A(s) = det(s/ - Ac) = s" + A^a„_i(s) 



For the hybrid adaptive law, we express e as 



Because the hybrid adaptive law guarantees that (a) ^^ G Zoo, (b) \0k+i — Ok\ G h and 
\0k+i — 9k\ —^ as k —> (X), we can construct a continuous, piecewise linear function 

0{t) from 0k using linear interpolation that satisfies: (a) \0 — 9k\,0 G C^o H'^a and 
(b) \0{t) — 0k{t)\ — > as t — > oo. Therefore, we can write 



^^ 



-6i'0+(6'-6'fe)'0 (5.5.7) 

From e G C2, \9 — ^fe| G C2 and G £00, we have 0^0 G £2- Because -^{0'^ (f>) = 
9 (f> + 0^4' and 0,9,4>,4> G £00, we conclude that -^{9^ 4>) ^ ^00, which, together 
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Adaptive Law 
(5.5.6) 



Figure 5.3 Adaptive observer using nonminimal Realization 1. 



with 9 (f) e C2, implies that 0(f) ^ as t — > 00. Therefore, we have established 
that [0 — Ok)^ (f) -^ and O'^ (f) -^ a.s t ^ (X). Thus, using (5.5.7) for e, we have 
that e{t) ^ as t ^ c». 

(iv) The proof of this part follows directly from the properties of the adaptive 
laws developed in Chapter 4 and Theorem 5.2.4 by noticing that (f) = H{s)u where 
H{s) is the same as in the proof of Theorem 5.2.4. □ 



The reader can verify that the adaptive observer of Table 5.4 is the state- 
space representation of the parameter identifier given by (5.2.17), (5.2.18) 
in Section 5.2.3. This same identifier is shared by the adaptive Luenberger 
observer indicating that the state (j) of the nonminimal state space repre- 
sentation of the plant is also part of the state of the adaptive Luenberger 
observer. In addition to (p, the adaptive Luenberger observer estimates the 
state of a minimal state space representation of the plant expressed in the 
observer canonical form at the expense of implementing an additional nth 
order state equation referred to as the observer equation in Table 5.1. The 
parameter identifiers of Section 5.2 can, therefore, be viewed as adaptive 
observers based on a nonminimal state representation of the plant. 
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5.5.2 Adaptive Observer Based on Realization 2 

An alternative nonniininial state-space realization for the plant (5.3.1), de- 
veloped in Chapter 2 and shown in Figure 2.5, is described by the state 
equations 

^1 = -Xoxi + 9*^(f), xi(0) = 
<j)i = Ac(pi + lu, (/>i(0) = 

Ac<p2-ly, 02(0) = (5.5.8) 



^2 



[u,4>J,y,4>J]^ 



to = AcU), uj(0) = uJo 

r]o = Cqlv 
y = xi + r]o 

where xi ^ TZ; (pi ^ 7l"'~^,i = 1,2; 6* e 7?-^" is a vector of linear 
combinations of the unknown plant parameters a = [a„_i, a„_2, • • . , ao]^) 
b = [bn-i, bn-2, • • • ) ^o]^ in the plant transfer function (5.3.7) as shown in 
Section 2.4; Aq > is a known scalar; Ac £ T^v"-!)^!"-!) is a known stable 
matrix; and (sJ-AJ"^/ = ^fif^, where A*(s) = s"-i + g„_2s""2 + . . . + go 
is a known Hurwitz polynomial. When 9* is known, the states Xi,(f)i, (j)2 can 
be generated exactly by the observer 

Xoi = -X0X01 + 9*^(f>, Xoi(O) = 
(^1 = Ac4>i + lu, (^i(O) = 



^2 



Ac(l>2 - ly, MO) = (5.5.9) 



J/O = Xol 



where Xoi, (pi are the estimates of xi,(p respectively. As in Section 5.5.1, no 
attempt is made to generate an estimate of the state uj, because uj(t) -^ 
as t ^ 00 exponentially fast. The state observer (5.5.9) guarantees that 
Xoiit) = xi(t),(pi(t) = (pi{t) , (p2(t) = (p2{t) Vt > 0. The observation error 

cq = y — yo satisfies 

i.e., eo(t) ^ as t ^ cx) with an exponential rate that depends on the matrix 
Ac that is chosen by the designer. 
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When 6* is unknown, (5.5.9) motivates the adaptive observer 

xi = — AqXi + cf), a;o(0) = 

(^1 = Ac(i)i + lu, MO) = 

i>2 = A,4>2 -ly, 02(0) = (5.5.10) 

y = XI 

where 9(t) is the estimate of 9* to be generated by an adaptive law and 
xi is the estimate of xi. The adaptive law for 9 is developed using the 
SPR-Lyapunov design approach as follows: 

We define the observation error y = y — y = xi + r]Q, where xi = xi — xi, 
and use it to develop the error equation 

§ = -Xoy-9'^(p + Cju (5.5.11) 

where Cj = XqCJ + Cj A^ and 9 = 9 - 9* by using (5.5.8) and (5.5.9), and 
the fact that 4> = (p. Except for the exponentially decaying to zero term CJlo, 
equation (5.5.11) is in the appropriate form for applying the SPR-Lyapunov 
design approach. 

In the analysis below, we take care of the exponentially decaying term 
CJlo by choosing the Lyapunov function candidate 

where T = P^ > 0; Pc = Pj > satisfies the Lyapunov equation 

PcAc + AjPc = -/ 

and /3 > is a scalar to be selected. The time derivative V of V along the 
solution of (5.5.11) is given by 

V = -Xof - y¥(t) + yCjio + ^^p-^^ - /3w^u; (5.5.12) 

As described earlier, if the adaptive law is chosen as 

9 = 9 = Vy(t) (5.5.13) 

(5.5.12) becomes 

V = -Aoy^ - (iiv^uj + yCjuj 
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If P is chosen as (3 > 2a ' ^^^^ it can be shown by completing the squares 
that 

V < y Lo CO 

- 2 ^ 2 

which impHes that V,9,y ^ Coo and y E £2- Because from (5.5.11) y E Coo 
it follows that y ^ as t ^ cx), i.e., y(t) -^ y{t) and xi{t) -^ xi{t) as t ^ cx). 



Hence, the overall state of the observer X 



^l,<^7><^2" 



converges to the 



Xl,<fl,(f2 



T 



as t ^ 00. In addition 9 E C2 f^ Cc 



overall plant state X 

and limi^oo ^(i) = 0. 

The convergence of 9(t) to 9* depends on the properties of the input u. 
We can show by following exactly the same steps as in the previous sections 
that if u is sufficiently rich of order 2n, then </> = (/) is PE, which, together 
with (pjip E Coo, implies that 9{t) converges to 9* exponentially fast. For 
(f) e Coo, we require, however, that u G £00 • 

The main equations of the adaptive observer are summarized in Table 
5.5 and the block diagram of the observer is shown in Figure 5.4 where 
9 = [9j,9j]'^ is partitioned into ^1 e 7^", ^2 e 7^". 

Example 5.5.1 Consider the LTI plant 

61S + bo 



y 



s^ + ais + ao 



(5.5.14) 



where Oi, ao > and 61, 60 are the unknown parameters. We first obtain the plant 
representation 2 by following the results and approach presented in Chapter 2. 

We choose A(s) = (s + Ao)(s + A) for some Aq, A > 0. It follows from (5.5.14) 
that 



A{s 



Because 



Ais) 



-y= [bi,bo] 

(Ao+A)s+AoA 
Ms) 



1 



A{s 



-u- [ai,ao] 



1 



A{s 



■y 



we have 



y = 0*T-L(f)„_e*T-L(£)y + A^^, 



Ms) 



A{s) 



A{s) 



(5.5.15) 



where 6*1; = [61, 60]^, 6*2 = [ai,ao]^,A= [Aq + A, AqA]^ and ai(s) = [s,!]"''. Because 
A(s) = (s + Ao)(s + A), equation (5.5.15) implies that 



1 



s + Ao 



.TC^iis\^_(^.T^iifly+x-r^^y 



^ s + X 



s + A' 
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Table 5.5 Adaptive observer (Realization 2) 



Plant 


^^ = -X^xi + e*^ct), xi(0) = 
(^1 = Ae(/.l + lu, MO) = 

<j>2 = Ac<l)2 - ly, MO) = 

CO = AcUJ, uj{0) = ujQ 

rjo = Cjuj 

y = xi + rjo 

where (f) = [u, <pj ,y, (pJV 

(pi e7^"-^ i = l,2; xi en^ 


Observer 


ii = -XoXi + e'^(p, xi(0) = 

(^1 = Ae(^i + lu, MO) = 

4>2 = Ac<^2 - ly, MO) = 

where (p = [u, (pj ,y, (pj]^ 
4>i e7^'*-l,i = 1,2, xi e7^l 


Adaptive law 


= ^y(p , y = y-y 


Design 
variables 


r = r^ > 0; Ac e n^^-^^xi^-^) is any stable matrix, 
and Ao > is any scalar 



Substituting for 
we obtain 

y 



ai{s) 



s + X s + X 



s 

_ 1 


= 


■ 1 ■ 




1 

1 


■ -A ■ 
1 


s + X 



1 



s + Ao 



biu + {bo - Xbi) — -—u - aiy - (ao - Aai) — — -y 
s + X s + X 



+ (Ao + X)y - y 



1 

1 

s + X^ 
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Figure 5.4 Adaptive observer using nonniinimal Realization 2. 

which impUes that 

xi = -XoXi + e*'^<p, Si(0) = 
01 = -X(pi+u, (/.i(0) = 

4)2 = -\(j>2-V, (/'2(0)=0 

y = xi 

where = [m, 0i, y, (/)2]^, d* = [6i,6o — A6i,Ao + A — ai,ao — Aai + A^]^. Using 
Table 5.5, the adaptive observer for estimating xi, 01, 02 and 9* is given by 

ii = -AoXi + ^^0, xi(0) = 

01 = -A01 + M, 0i(O)=O 

02 = -A02-y, 02(0) = 
y = Xi 

e = T4>{y-y) 

where = [u, 0i, y, 02]^ and F = F^ > 0. If in addition to 6* , we like to estimate 
0* = [bi,bo,ai,ao]^ , we use the relationships 



h 

bo 


— 


O2 + XSi 




ai 


= 


-O3 + Ac 


+ A 


ao 


= 


04 — A^3 


+ AAo 
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where 6i,i = 1,2,3,4 are the elements of 9 and bi,ai,i = 1,2 are the estimates of 
6i, Oi, i = 0, 1, respectively. 

For parameter convergence we choose 

u = 6sin2.6t + 8sin4.2i 
which is sufficiently rich of order 4. □ 



5.6 Parameter Convergence Proofs 

In this section we present all the lengthy proofs of theorems dealing with convergence 
of the estimated parameters. 



5.6.1 Useful Lemmas 

The following lemmas are used in the proofs of several theorems to follow: 

Lemma 5.6.1 // the autocovariance of a function x : TV^ i-^ 7^" defined as 

fto+T 



^ to 



x{t)x' {t+T)dT (5.6.1) 



exists and is uniform with respect to ta, then x is PE if and only if Rx{0) is positive 
definite. 

Proof 

If: The definition of the autocovariance Rx{0) implies that there exists a Tg > 
such that 

^RAO) <^ r ' x{T)x'^{T)dT < ^/?,(0), \/t > 

^ J^o Jt„ ^ 

If -Ra;(0) is positive definite, there exist ai,a2 > such that a\I < Rx{0) < a2l. 
Therefore, 

1 1 /"^o+^o o 

-ai/< -r- I x(t)x Mdr < -aol 

2 ' - To y,„ ^ ^ ^ ^ - 2 ' 

for all tQ > and thus x is PE. 

Only if: If x is PE, then there exist constants ao,Ti > such that 

t+Ti 

x{t)x [T)dT > aoTiI 
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for all t > 0. For any T > Ti, we can write 



rto+T k~l ^t„ + (i+l)Ti rto+T 

/ x{t)x {T)dT = / / x[t)x {T)dT -\- / x{t)x 

J to j^g Jto+iTi Jto + kTi 



{T)dT 



> kaoTiI 



where k is the largest integer that satisfies k < T/Ti, i.e., kTi < T < {k + l)Ti. 
Therefore, we have 



1 



t+T 



J, I x{T)x'^{T)dT > —aol 



For A: > 2, we have ^ = -^^^^^ - ^ > 1 - ^ > 5, thus, 

- / x{T)x''{T)dT > -fl 

^ tn 



and 



1 



tn+T 



ao 



RAO) = lim ^ I x{T)x'^{T)dT > ^J 



which implies that Rx(0) is positive definite. 



D 



Lemma 5.6.2 Consider the system 

y = H{s)u 

where H{s) is a strictly proper transfer function matrix of dimension m x n with 
stable poles and real impulse response hit). If u is stationary, with autocovariance 
Ru{t), then y is stationary, with autocovariance 

/oo /*oo 
/ h{Tl)Ru{t + Tl - T2)h'^ {T2)dTldT2 

and spectral distribution 

Sy{u) = H{-JLu)Su{L0)H^{JLu) 

Proof See [201]. 

Lemma 5.6.3 Consider the system described by 



Xl 
X2 



A -F'^it) 

PiF{t)P2 



Xl 
X2 



(5.6.2) 
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where xi G TZ"'^,X2 G 7?,''"^ for some integer r, ni > 1, A,Pi,P2 are constant 
matrices and F{t) is of the form 



F{t) 



Zllni 



^r-'ni 



en'^ 



where Zi,i = l,2,...,r are the elements of the vector z G TZ^ . Suppose that z is PE 
and there exists a matrix Pq > such that 



Po + AjPo + PoAo + CoCj < 



(5.6.3) 



where 



Ao 



A -F^{t) 

PiF{t)P2 



, C = [/n,,0] 



Then the equilibrium xie = Q,X2e = of (5.6.2) is e.s. in the large. 
Proof Consider the system (5.6.2) that we express as 

X = j4o(i)a; 
y = Cjx = xi 



(5.6.4) 



where x = [xj ,xj]^ . We first show that {Co,Ao) is UCO by estabhshing that 
(Co, ^0 + F^Cq) is UCO for some K G Coo which according to Lemma 4.8.1 implies 
that {Co,Ao) is UCO. We choose 



K 



-lln, - A 
-PlF{t)P2 



for some 7 > and consider the following system associated with [Cq, Aq + KCj ): 

(5.6.5) 



Yi ' 




■ -7/n. - 


F^{t 


) ■ 




■ Yi 


Y2 . 









. Y2 




y 


1 = [In, 0] 


■ Yi ■ 
. Y2 . 









According to Lemma 4.8.4, the system (5.6.5) is UCO if 

1 



Ffit) 



s + 7 



F{t) 



satisfies 



alrm < 



t+T 



Ff{T)Fj{T)dT<l3Irn„ Vi > 



(5.6.6) 
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for some constants a,f3,T> 0. We prove (5.6.6) by first showing that F{t) satisfies 



L^ ^rn.i _; 



t+T 



F{T)F'^{T)dT< (3'lrn,, Vi > 



for some constants a , (] as follows: Using a linear transformation, we can express 
F{t) as 

F{t) = FoZ{t) 

where Fq G ■jirnixmi jg ^^ constant matrix of full rank, Z G 7^'""i><"i is g, block 

diagonal matrix defined as Z = diagjz, z, . . . , z}, i.e.. 



Zl 


• 


■ 


Z2 


• 


• 


2^ni 


• 


• 





Zl 








Zn, 














Zl 



Therefore, FF' = FqZZ' F^ and 



ZZ = diagjz^ , zz , . . . , zz } 



Because z is PE, we have 



aiF < 



T 



t+T 



zz' dT < a2lr, Vt > 



for some ai,a2,T > 0. Therefore, 



ailrm < 



1 



t+T 



Z{T)Z^{T)dT < a2lrm , Vi > 



which implies that 



aiFoF^ < 



t+T 



F{T)F^{T)dT < a2FoFj, Vi > 
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Because Fq is of full rank, we have 

Pllrm < FqFq < /32-frni 

for some constants f3i,p2 > 0. Hence, 

1 /"*+^ 
alrm<^j F{T)F'^{T)dT<l3 Irn,, yt>0 (5.6.7) 

where /3 =a2/32,a = ai(3i. 

Following the same arguments used in proving Lemma 4.8.3 (iv), one can show 
(see Problem 5.18) that (5.6.7) implies (5.6.6). 

Because all the conditions in Lemma 4.8.4 are satisfied, we conclude, by apply- 
ing Lemma 4.8.4 that (5.6.5) is UCO, which in turn implies that (5.6.2) is UCO. 
Therefore, it follows directly from Theorem 3.4.8 and (5.6.3) that the equilibrium 
Xie = 0, X2e = of (5.6.2) is e.s. in the large. D 



5.6.2 Proof of Theorem 5.2.1 

According to Lemma 5.6.1, Theorem 5.2.1 can be proved if we establish that R^{Q) 
is positive definite if and only if u is sufficiently rich of order n. 

If: We will show the result by contradiction. Because u is stationary and R^{0) 
is uniform with respect to t, we take i = and obtain [186] 



T^oo 1 Jq It: J_^ 



(5.6.8) 



where S^{(jj) is the spectral distribution of <f). From Lemma 5.6.2, we have 

S^{uj) = H{-JLu)Su{io)H^{jiu) (5.6.9) 

Using the condition that u is sufficiently rich of order n, i.e., u has spectral lines at 
n points, we can express Su{^) as 

n 
Su{uj) = ^fu{cOi)S{uJ -LUi) (5.6.10) 

i=l 

where fu{^i) > 0. Using (5.6.9) and (5.6.10) in (5.6.8), we obtain 

1 " 

ZTT '^ — ' 

Suppose that R^{0) is not positive definite, then there exists x G TZ"' with x ^ 
such that 

n 
X'^R40)X = Y, fu{uJ^)x'^H{-jLJ,)H^{jLUi)x = (5.6.11) 
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Because fu{^i) > and each term under the summation is nonnegative, (5.6.11) 
can be true only if: 



or equivalently 



X H{—JLJi) = 0, i = l,2,...,n 



(5.6.12) 



However, (5.6.12) implies that {H{juJi), H{jlu2)t ■ . ■ , H{juJn)} are linearly depen- 
dent, which contradicts with the condition that H{JLUi), . . . H{JLUn) are linearly 
independent for all cji, . . . ,lj„. Hence, R^{0) is positive definite. 

Only if: We also prove this by contradiction. Assume that i?0(O) is positive 
definite but u is sufficiently rich of order r < n, then we can express i?0(O) as 



1 '' 
^40) =—Y.fu{co^)H{-Ju;,)H^{- 
Ztt '■ — ' 



-J^i 



where fuii-^i) > 0. Note that the right hand side is the sum of r — dyads, and the 
rank of R^{0) can be at most r < n, which contradicts with the assumption that 
R,p{0) is positive definite. D 



5.6.3 Proof of Theorem 5.2.2 

We first consider the series-parallel scheme (5.2.11). From (5.2.10), (5.2.11) we 
obtain the error equations 



El = Am^i — Bu — Ax 
A = ^eix^ , B = 7eiu 



(5.6.13) 



7 A 



^ A 



where A = A- A, B = B - B a.nd B e TZ^'^^^A e yl"""". For simplicity, let us take 
7i = 72 = 7- The parameter error A is in the matrix form, which we rewrite in the 
familiar vector form to apply the stability theorems of Chapter 3 directly. Defining 
the vector 



^ r-T -T 



,5;[,B^]^e7e"("+i) 



where a, is the ith column of A, we can write 



Ax + Bu = [fli, 02 



, . . . , lA^j 



Xl 
X2 



Bu = F^{t)§ 
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where _F^(t)= [xi/„, X2ln, • • • , a;„/„, u/„] (=7^"X"("+i), Because 0^ = 7610;^, B = jeiu, 
the matrix differential equations for A, B can be rewritten as 

Therefore, (5.6.13) is equivalent to 

f ei = A„,ei - F^ (t)0 

{ .: ^ ' 5.6.14) 

\ e = -fF{t)e, 

which is in the form of (5.6.2). To apply Lemma 5.6.3, we need to verify that all 
the conditions stated in the lemma are satisfied by (5.6.14). 

We first prove that there exists a constant matrix Pg > such that 

^0 -^0 + PqAq = —CqCq 
where 



^0 



A -F^{t) 
jF{t) 



G 7?("+"("+i))^("+"("+i)) c^ = f/ 0] G 7?"+"("+i) 



In Section 4.2.3, we have shown that the time derivative of the Lyapunov function 

-r (a'^pA] (b'^pb] 

(with 71 = 72 = 7) satisfies 

V=-eJei (5.6.15) 

where P satisfies A^P + PAm = —In- Note that 

n 

tr ji^Pij = ^hJPh, 

i=l 

txiB^PB\ = B^PB 

where the second equality is true because B G 7^"^^. We can write 

1 " 1 - - 

V = eJPei + — V aJPd^ + —B^PB = x'^ Pqx 

where x = [ej ,6^^]^ and Pq is a block diagonal matrix defined as 

Po = diag{P,7f ip, . . . ,7f ip,72"ip} G 7e(«+«("+i))x («+«("+!)) 
n-times 
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Hence, (5.6.15) implies that 

V = x'^iPoAo + A^Po)x = -x'^CoCj, 
or equivalently 



Po + PoAa + <Po = -CaCi, Po = 



(5.6.16) 



A 



Next, we show that z = [xi, X2, . . . , a;„, u]^ is PE. We write 
z = H{s)u, H{s) 



{sI-A)-^B 
1 



If we can show that H{jll!i), H{jll!2), . ■ . , H{JLUn+i) are linearly independent for 
any uji,lu2, ■ . ■ ,LUn+i, then it follows immediately from Theorem 5.2.1 that z is PE 
if and only if u is sufficiently rich of order n + I. 

Let a{s) = det(s/ — A) = s" + an-is"~^ + . . . + ais + ag. We can verify using 
matrix manipulations that the matrix {si — A)^^ can be expressed as 

{sI-Ar^ = ^{/s"-i + (^ + a„_i/)s"-2^(^2^a„_iA+a„_2/).s"^' 
a{s) 

+ ... + (^"-1 + a„_i^"-2 ^ _ ^ ^ ^ ^^j)| (5.6.17) 

Defining 

bi=B, b2 = {A + ar,-iI)B, 63 = (^2_^a„_iA+a„_2/)5,...,6„ = (A"-V... + ai/)S 

L=[6i,62,...,6„]e7e"^" 
and then using (5.6.17), H{s) can be conveniently expressed as 



H{s) 









L 


s 

1 






o(s) 





1 

a{s) 



(5.6.18) 



A 



To explore the linear dependency of H{JLUi), we define H = [H{jll!i) , H{jlu2) 
H{JLOn+i)]- Using the expression (5.6.18) for H{s), we have 



H 



L 0„xi 



Oi> 



(M)"-i {juj2r-' 



{ju^+ir-^ 

(jW„+l)"-2 



1 


JUJ2 

1 


1 


a(jwi) 


a{joj2) 


a(jw„+i) 
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a{jiAJi) 







1 

a(iuj2) 



Prom the assumption that {A, B) is controllable, we conclude that the matrix L 
is of full rank. Thus the matrix H has rank of n + 1 if and only if the matrix Vi 
defined as 



Vi 



A 



(M)"-2 



1 

a{juji) 






J^2 

1 

a{juj2) 






in-2 



J^)i 



a{juj„ 



has rank of n+ 1. Using linear transformations (row operations), we can show that 
Vi is equivalent to the following Vandermonde matrix [62]: 



V : 



(M) 
(j^l)" 



1 



(j^2)" 
(j^2)"-l 



3^2 

1 



(j^n+l) 



1 



Because 



det(y) 



n (-^'^^ ~ •?'^fe) 



l<i<k<n+l 



V is of full rank for any LOi with uoi ^ ujk i,k = l,...n + 1. This leads to 
the conclusion that Vi and, therefore, H have rank of n + 1, which implies that 
H[JLOi), H{JLU2), . . . , H{JLUn-{-i) are linearly independent for any lui, lu2, ■ ■ ■ ^n+i- It 
then follows immediately from Theorem 5.2.1 that z is PE. 

Because we have shown that all the conditions of Lemma 5.6.3 are satisfied by 
(5.6.14), we can conclude that a;e = of (5.6.14) is e.s. in the large, i.e., ei,^ — > 
exponentially fast as t —> oo. Thus, A —> A, B —> B exponentially fast as i — > c», 
and the proof of Theorem 5.2.2 for the series-parallel scheme is complete. 

For the parallel scheme, we only need to establish that z = [x'^ ,u]^ is PE. The 
rest of the proof follows by using exactly the same arguments and procedure as in 
the case of the series-parallel scheme. 

Because x is the state of the plant and it is independent of the identification 
scheme, it follows from the previous analysis that z is PE under the conditions given 
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in Theorem 5.2.2, i.e., {A, B) controllable and u sufficiently rich of order n+l. From 
the definition of ei, we have 



X = X — ei, z = z ■ 



Onxl 

1 



ei 



thus the PE property of z follows immediately from Lemma 4.8.3 by using ei G C2 
and z being PE. D 



5.6.4 Proof of Theorem 5.2.3 

We consider the proof for the series-parallel scheme. The proof for the parallel 
scheme follows by using the same arguments used in Section 5.6.3 in the proof of 
Theorem 5.2.2 for the parallel scheme. 

Following the same procedure used in proving Theorem 5.2.2, we can write the 
differential equations 



£1 

A 

B 



AmSi + {A- A)x +{B - B)u 



^eix 



leiu 



in the vector form as 



ei = A„,ei-F^{t)9 
9 = F{t)ei 



(5.6.19) 



where = \al , a J , . 



A 



, 6 ' ] and a^ , hi denotes the ith column of 



A,B, respectively, F^ {t) = [a;i/„,a;2/„, ..., a;„/„,ui/„,M2 /«,••-, «,/„]. Following 
exactly the same arguments used in the proof for Theorem 5.2.2, we complete the 
proof by showing (i) there exists a matrix Pq > such that Aq Po + PqAo = —CqCq, 

where Aq, Cq are defined the same way as in Section 5.6.3 and (ii) z = [xi, X2, ■ ■ ., 
x„. Ml, U2, ■ ■ ., Ug]^ is PE. 

The proof for (i) is the same as that in Section 5.6.3. We prove (ii) by showing 
that the autocovariance of z, Rz{0) is positive definite as follows: We express z as 



{si- A)-^B 



E 



{sI-A)-% 
e,: 



Ui 



where Iq G TZ'^^i is the identity matrix and 6^,6^ denote the ith column of B,Iq, 
respectively. Assuming that Ui,i = l,...,q are stationary and uncorrected, the 
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autocovariance of z can be calculated as 

9 ,.00 



1 r 

^TT .^^ J-00 



{-juj)S^S^)Hj{ju) 



where 



H^{S) 



{■sI-A)-^h 



and Sui{^) is the spectral distribution of Ui. Using the assumption that Ui is 
sufficiently rich of order n + 1 , we have 



n+l 



SuA^) = zJ f■u^{^ik)S{uJ - LUik) 



k=l 



and 



1 r^^ 1 ^"^"^ 

;^ / Hi{-ju;)Su,{uj)Hj{juj) = —^fu^{uJ^k)H,{-juJ,k)HJ{juJik) 



where fmi^ik) > 0. Therefore, 



(5.6.20) 



, 9 n+l 

i=i fc=i 

Let us now consider the solution of the quadratic equation 

x^R,{{))x = 0, xe 7e"+« 

Because each term under the summation of the right-hand side of (5.6.20) is semi- 
positive definite, x^Rz{Q)x = {) is true if and only if 



fuA^ik)x^ Hi{-jUJik)Hj {juJik)x = 0, 

or equivalently 



i = l,2,...q 
k= 1,2, ...n + l 



Because Hi{s) = ^ 
alent to: 



(«) 



where a{s) = det[sl— A), (5.6.21) is equiv- 



adj(a/ — A)hi 



A 



H^ {Mk)x = 0, H,{s) = a{s)H,{s) 



i=l,2,...q 
k= 1,2, ...n+ 1 



(5.6.22) 
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Noting that each element in Hi is a polynomial of order at most equal to n, we 

find that gi{s) = Hj {s)x is a polynomial of order at most equal to n. Therefore, 
(5.6.22) implies that the polynomial gi{s) vanishes at n + 1 points, which, in turn, 
implies that gi{s) = for all s e C. Thus, we have 



HJ[s)x = Q, i=l,2, 



■ q 



for all s. Equation (5.6.23) can be written in the matrix form 

T 

x = Q„ 



a.d]{sl - A)B 

a{s)Iq 



(5.6.23) 



(5.6.24) 



where 0„ G TV^ is a column vector with all elements equal to zero. Let X = 
[a;i, . . . , x„] e 7e", Y = [x„+i, . . . , x^+q] e TZ", i.e., x = [X^ ,Y^]'^ . Then (5.6.24) 
can be expressed as 

{a.di{sl -A)B)'^X + a{s)Y = 0q (5.6.25) 

Consider the following expressions for adj(s/ — A)B and a{s): 



adi{sI-A)B = Bs""' 



a{s) 



- {AB + a„_iB)s""2_^ {A^B + a„_iAB - 
(A"-iB + a„_iA"-25 + . . . + aiB) 



2B)s' 



Un-is" ^ + ... + ais + ao 



and equating the coefficients of s* on both sides of equation (5.6.25), we find that 
X, Y must satisfy the following algebraic equations: 

Y = % 

B^X + an-iY = Oq 

{AB + an-iB^X + an-2Y = 0„ 



(A'^ 



a„_iA"-2s - 



aiB^X + aoY = % 



or equivalently: 



Y = Q and {B,AB,...,A''-^B)^X = Q 



■nq 



(5.6.26) 



where is a zero column- vector of dimension nq. Because [A, B) is controllable, 
the matrix [B, AB, . . . A"^^^B) is of full rank; therefore, (5.6.26) is true if and only 
if X = 0,y = 0, i.e. x = {). 

Thus, we have proved that x^ Rz{Q)x = if and only if a; = 0, which implies 
that -Rz(O) is positive definite. Then it follows from Lemma 5.6.1 that z is PE. 

Using exactly the same arguments as used in proving Theorem 5.2.2, we con- 
clude from z being PE that ei(t), 0{i) converge to zero exponentially fast as i ^ c». 
Prom the definition of 6 we have that A[t) —> A, B{t) —> B exponentially fast as 
i — > oo and the proof is complete. □ 
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5.6.5 Proof of Theorem 5.2.5 

Let us define 

where 6{t) = 9{i) — 6*. We will show that e{t) ^ as i ^ c», i.e., for any given 
e > 0, there exists a ti > such that for all t > ti, e(i) < e . 
We express e as 



ti+T 



+6'^ it) Ir^o) --j^ (^(T)0^(T)rfT j m 

^ ''' [F[r)^[r)fdT+^l^^ [{¥{t)<i>{T)f-{e'^{T)c^{r)f]dr 

ti+T 
( 
ti ) 






= ei{t) + e2{t) + e^it) 

where ti,T are arbitrary at this point and will be specified later. We evaluate each 
term on the right-hand side of the above equation separately. 

Because e{t) = 0^ {t)(t>{t) ^ as i — > oo, there exists a. ti > Q such that 

k(*)l "^ v T fo'" t > ti. Choosing fi > ti, we have 

|ei(i)| = ^^*'^ e'{T)dT<'- (5.6.27) 

For £2(0; we have 

e{a)da 4>{t)(I)'^ {T){d{t) + 0{T))dT 



Using the property of the adaptive law that — > as t — > c», for any given 
T, e we can find a tj ^ such that for all t > igi 1^(^)1 ^ Wt' '^tiere K = 
sup( ^ \(t)[T)<f)^ [T)[9[t) + 0{t))\ is a finite constant because of the fact that both 9 
and are uniformly bounded signals. Choosing ti > ^2; '^^ have 

|e2W| < ^^*'^ ^^^^l0(r)0^(r)(e» + %))Mr < I (5.6.28) 



1 


r-ti+T 


T , 


L 


1 


i-ti+T 


T . 


L 



310 



CHAPTER 5. IDENTIFIERS AND ADAPTIVE OBSERVERS 



for all t > ij- 

Because the autocovariance R^{0) exists, there exists Tq > such that for all 
T > To, 

R^O) -1= r ,/.(T)0^(T)dr < 



^K' 



where K = supj |0(i)P is a finite constant. Therefore, 



|e3|< 



(5.6.29) 



A 



Combining (5.6.27) to (5.6.29), we have that for t > maxjij^jig} = ti, T > Tq, 

e{t) = e'^{t)R40)e{t) < e 
which, in turn, implies that e; therefore, i?0(O)(? converges to zero as t — > oo. D 



5.7 Problems 



5.1 Show that 



Asm{t + ip) 
sin(i) 



where A, ip are nonzero constants is PE in Ti? 



5.2 Consider the following plant 



y 



bi-s 



(s+l)2 



where 6i is the only unknown parameter. Is u = Cg (constant ) ^ sufficiently 
rich for identifying 6i? Explain. Design a parameter identifier to identify bi 
from the measurements of u, y. Simulate your scheme on a digital computer 
for 6i = 5. 



5.3 Consider the plant 



y 



(s + 2)3 



where 62 , &o are the only unknown parameters. Is w = sin t sufficiently rich 
for identifying &2,^o where 62,60 can be any number in TZ. Explain. Design 
a parameter identifier to identify 62)60. Simulate your scheme for a) 62 = 
1, 60 = 1 and b) 62 = 3, 60 = 5. 
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5.4 Consider the second order stable plant 



ai 1 



6i 
1 



where ai, Oq, &i are the only unknown parameters and u G C^o- 

(a) Design a parameter identifier to estimate the unknown parameters. 

(b) Choose u with the least number of frequencies that guarantees param- 
eter convergence. 

(c) Simulate your scheme for ai = —2, ag = —5, 6i = 8. 

5.5 Simulate the series-parallel identifier in Example 5.2.2. Repeat Example 5.2.2 

by designing and simulating a parallel identifier. In simulations use numerical 
values for A, B of your choice. 

5.6 Perform the simulations requested in (i) and (ii) of Example 5.2.3 when Bq = 

—2, oi = 2.8, ao = 5.6. Comment on your results. 

5.7 Repeat Problem 5.6 when the pure least-squares algorithm in Example 5.2.3 is 

replaced with the least-squares with covariance resetting algorithm. 

5.8 Repeat Problem 5.6 when the pure least-squares algorithm in Example 5.2.2 is 

replaced with the 

(a) Integral algorithm 

(b) Hybrid adaptive law. 

5.9 Design an adaptive Luenberger observer for the plant 



— fll 1 
-ao 


x + 


bi 
1 


[l,0]a; 







y 

where ai,ao > and bi ^ are the only unknown parameters using the 
following adaptive laws for on-line estimation: 

(a) Integral algorithm 

(b) Pure least-squares 

(c) Hybrid adaptive law 

In each case present the complete stability proof. Simulate the adaptive 
observers with inputs u of your choice. For simulation purposes assume that 
the unknown parameters have the following values: ai = 2.5, Oq = 3.6, 6i = 4. 

5.10 Repeat Problem 5.9 by designing an adaptive observer with auxiliary input. 

5.11 Consider the LTI plant 



y 



bo 



s^ + ais + 02 



312 CHAPTER 5. IDENTIFIERS AND ADAPTIVE OBSERVERS 

where 69 7^ 0, and ai,a2 > 0. Represent the plant in the following forms: 

(a) Observable form 

(b) Nonminimal Realization 1 

(c) Nonminimal Realization 2 

5.12 Design an adaptive observer using an integral adaptive law for the plant of 
Problem 5.11 represented in the observer form. 

5.13 Repeat Problem 5.12 for the same plant in the nonminimal Realization 1. 

5.14 Design an adaptive observer for the plant of Problem 5.11 expressed in the 
nonminimal Realization 2. 

5.15 Consider the following plant: 

y = Wo{s)G{s)u 

where Wo(s) is a known proper transfer function with stable poles and G{s) 
is a strictly proper transfer function of order n with stable poles but unknown 
coefficients. 

(a) Design a parameter identifier to identify the coefficients of G{s). 

(b) Design an adaptive observer to estimate the states of a minimal realiza- 

tion of the plant. 

5.16 Prove that there exists a signal vector v G TZ" available for measurement for 
which the system given by (5.4.2) becomes 

nT I 



y 



where (f) = H{s) 



G TZ and H{s) is a known transfer matrix. 



u 
V 

5.17 Use the result of Problem 5.16 to develop an adaptive observer with auxiliary 
input that employs a least-squares algorithm as a parameter estimator. 

5.18 Let F(t) : H 1-^ jinxm ^^^^^ p^p ^ jr^ jf ^i^Q^e exist positive constants 
ki,k2, Tq such that 

/•t+To 

kil 



1 /"t-t-JQ 

Jn<^ F{T)F^{T)dT < k2ln 

J^O Jt 



for any t > 0, where /„ is the identity matrix of dimension n, show that if 

b „ 



r f ^ r 

■' s + a 

with a > 0, 6 7^ 0, then there exist positive constants /cj^, fcj, Tq such that 



•-0 
for any i > 0. 



1 /■'+-' 

kjn<^ Ff{r)Fj{T)dT<k2ln 



Chapter 6 

Model Reference Adaptive 
Control 

6.1 Introduction 

Model reference adaptive control (MRAC) is one of the main approaches 
to adaptive control. The basic structure of a MRAC scheme is shown in 
Figure 6.1. The reference model is chosen to generate the desired trajectory, 
ym, that the plant output yp has to follow. The tracking error ei = yp — ym 
represents the deviation of the plant output from the desired trajectory. 
The closed-loop plant is made up of an ordinary feedback control law that 
contains the plant and a controller C{9) and an adjustment mechanism that 
generates the controller parameter estimates 6{t) on-line. 

The purpose of this chapter is to design the controller and parameter ad- 
justment mechanism so that all signals in the closed-loop plant are bounded 
and the plant output yp tracks ym as close as possible. 

MRAC schemes can be characterized as direct or indirect and with nor- 
malized oi unnornialized adaptive laws. In direct MRAC, the parameter vec- 
tor 9 of the controller C(9) is updated directly by an adaptive law, whereas 
in indirect MRAC 9 is calculated at each time t by solving a certain algebraic 
equation that relates 9 with the on-line estimates of the plant parameters. 
In both direct and indirect MRAC with normalized adaptive laws, the form 
of C(9), motivated from the known parameter case, is kept unchanged. The 
controller C{9) is combined with an adaptive law (or an adaptive law and 
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Figure 6.1 General structure of MRAC scheme. 



an algebraic equation in the indirect case) that is developed independently 
by following the techniques of Chapter 4. This design procedure allows the 
use of a wide class of adaptive laws that includes gradient, least-squares and 
those based on the SPR-Lyapunov design approach. On the other hand, 
in the case of MRAC schemes with unnormalized adaptive laws, C{9) is 
modified to lead to an error equation whose form allows the use of the SPR- 
Lyapunov design approach for generating the adaptive law. In this case, 
the design of C{0) and adaptive law is more complicated in both the di- 
rect and indirect case, but the analysis is much simpler and follows from a 
consideration of a single Lyapunov-like function. 

The chapter is organized as follows: In Section 6.2, we use several exam- 
ples to illustrate the design and analysis of a class of simple direct MRAC 
schemes with unnormalized adaptive laws. These examples are used to mo- 
tivate the more general and complicated designs treated in the rest of the 
chapter. In Section 6.3 we define the model reference control (MRC) prob- 
lem for SISO plants and solve it for the case of known plant parameters. 
The control law developed in this section is used in the rest of the chapter 
to form MRAC schemes in the unknown parameter case. 

The design of direct MRAC schemes with unnormalized adaptive laws is 
treated in Section 6.4 for plants with relative degree n* = 1,2,3. The case of 
n* > 3 follows by using the same techniques as in the case of n* = 3 and is 
omitted because of the complexity of the control law that increases with n* . 
In Section 6.5 we consider the design and analysis of a wide class of direct 
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MRAC schemes with normahzed adaptive laws for plants with arbitrary but 
known relative degree. 

The design of indirect MRAC with unnormalized and normahzed adap- 
tive laws is considered in Section 6.6. In Section 6.7, we briefly summarize 
some efforts and alternative approaches to relax some of the basic assump- 
tions used in MRAC that include the minimum phase, known relative degree 
and upper bound on the order of the plant. In Section 6.8, we present all 
the long and more complicated proofs of theorems and lemmas. 

6.2 Simple Direct MRAC Schemes 

In this section, we use several examples to illustrate the design and analysis 
of some simple direct MRAC schemes with unnormalized adaptive laws. We 
concentrate on the SPR-Lyapunov approach for designing the adaptive laws. 
This approach dominated the literature of adaptive control for continuous- 
time plants with relative degree n* = 1 because of the simplicity of design 
and stability analysis [48, 85, 172, 201]. 

6.2.1 Scalar Example: Adaptive Regulation 

Consider the following scalar plant: 

X = ax + u, x(0) = xq (6.2.1) 

where a is a constant but unknown. The control objective is to determine 
a bounded function u = f(t, x) such that the state x(t) is bounded and 
converges to zero as t ^ oo for any given initial condition xq. Let —am be 
the desired closed-loop pole where a™ > is chosen by the designer. 

Control Law If the plant parameter a is known, the control law 

u = -k*x (6.2.2) 

with k* = a + am could be used to meet the control objective, i.e., with 
(6.2.2), the closed- loop plant is 
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whose equilibrium Xg = is e.s. in the large. 

Because a is unknown, k* cannot be calculated and, therefore, (6.2.2) 
cannot be implemented. A possible procedure to follow in the unknown 
parameter case is to use the same control law as given in (6.2.2) but with k* 
replaced by its estimate k{t), i.e., we use 

u=-k{t)x (6.2.3) 

and search for an adaptive law to update k(t) continuously with time. 

Adaptive Law The adaptive law for generating k(t) is developed by view- 
ing the problem as an on-line identification problem for k* . This is ac- 
complished by first obtaining an appropriate parameterization for the plant 
(6.2.1) in terms of the unknown k* and then using a similar approach as in 
Chapter 4 to estimate k* on-line. We illustrate this procedure below. 

We add and subtract the desired control input — A:*x in the plant equation 
to obtain 

X = ax — k*x + k*x + u. 

Because a — k* = —am we have 

X = —amX + k*x + u 

or 

x = {u + k*x) (6.2.4) 

s + am 

Equation (6.2.4) is a parameterization of the plant equation (6.2.1) in terms 
of the unknown controller parameter k* . Because x,u are measured and 
am > is known, a wide class of adaptive laws may be generated by simply 
using Tables 4.1 to 4.3 of Chapter 4. It turns out that the adaptive laws 
developed for (6.2.4) using the SPR-Lyapunov design approach without nor- 
malization simplify the stability analysis of the resulting closed- loop adaptive 
control scheme considerably. Therefore, as a starting point, we concentrate 
on the simple case and deal with the more general case that involves a wide 
class of adaptive laws in later sections. 

Because — r — is SPR we can proceed with the SPR-Lyapunov design 
approach of Chapter 4 and generate the estimate x of a: as 

x = [kx + u] = (0) (6.2.5) 

S -]- dm ^ "T ^m 
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where the last equahty is obtained by substituting the control law u = —kx. 
If we now choose x(0) = 0, we have x(t) = 0, Vt > 0, which iniphes that the 
estimation error ei defined as ei = x — x is equal to the regulation error, 
i.e., ei = X, so that (6.2.5) does not have to be implemented to generate 
X. Substituting for the control u = —k{t)x in (6.2.4), we obtain the error 
equation that relates the parameter error k = k — k* with the estimation 
error ei = x, i.e., 

ei = —am^i — kx, €i = X (6.2.6) 

or 

ei = \—kx 

As demonstrated in Chapter 4, the error equation (6.2.6) is in a convenient 
form for choosing an appropriate Lyapunov function to design the adaptive 
law for k{t). We assume that the adaptive law is of the form 

k = k = fiiei,x,u) (6.2.7) 

where /i is some function to be selected, and propose 

F(e„^) = | + ^ (6.2.8) 

for some 7 > as a potential Lyapunov function for the system (6.2.6), 
(6.2.7). The time derivative of V along the trajectory of (6.2.6), (6.2.7) is 
given by 

V = -amt\ - keix + — (6.2.9) 

7 

Choosing /i = 7eix, i.e., 

k = 7eix = 7x^ A;(0) = fco (6.2.10) 

we have 

V = -am4<^ (6.2.11) 

Analysis Because F is a positive definite function and F < 0, we have 
V e Coo, which implies that ei,k £ Coo- Because ei = x, we also have 
that X e £00 and therefore all signals in the closed-loop plant are bounded. 
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Furthermore, ei = x £ £2 and ei = i G £00 (which follows from (6.2.6) ) 
imply, according to Lemma 3.2.5, that ei(t) = x(t) -^ as t ^ 00. From 
x(t) -^ and the boundedness of k, we establish that k(t) -^ 0, u(t) -^ 
as t ^ 00. 

We have shown that the combination of the control law (6.2.3) with the 
adaptive law (6.2.10) meets the control objective in the sense that it forces 
the plant state to converge to zero while guaranteeing signal boundedness. 

It is worth mentioning that as in the simple parameter identification 
examples considered in Chapter 4, we cannot establish that k(t) converges 
to k* , i.e., that the pole of the closed-loop plant converges to the desired one 
given by —am- The lack of parameter convergence is less crucial in adaptive 
control than in parameter identification because in most cases, the control 
objective can be achieved without requiring the parameters to converge to 
their true values. 

The simplicity of this scalar example allows us to solve for ei = x explic- 
itly, and study the properties of k(t), x(t) as they evolve with time. We can 
verify that 



2ce-'=* 
c+ kf) — a + (c — ko + a) e~ 



^iW = :^^^ ^^7 — ,. , ^N.-2ct ^i(0)' ^1 



where c^ = 7X9 + (fco — a) , satisfy the differential equations (6.2.6) and 
(6.2.10) of the closed-loop plant. Equation (6.2.12) can be used to investigate 
the effects of initial conditions and adaptive gain 7 on the transient and 
asymptotic behavior of x(t), k{t). We have limt^oo k(t) = a + c if c> and 
lim^^oo k(t) = a — c if c < 0, i.e., 

lim k(t) = koo = a+ J-fxf. + (ko - af (6.2.13) 

Therefore, for xq / 0, k(t) converges to a stabilizing gain whose value de- 
pends on 7 and the initial condition XQ,kQ. It is clear from (6.2.13) that 
the value of k^o is independent of whether Ajq is a destabilizing gain, i.e., 
< A;o < a, or a stabilizing one, i.e., ko > a, as long as (ko — a) is the same. 
The use of different fco, however, will affect the transient behavior as it is 
obvious from (6.2.12). In the limit as t ^ 00, the closed-loop pole converges 
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Figure 6.2 Block diagram for implementing the adaptive controller 
(6.2.14). 

to — (fcoo — ffl), which may be different from —am- Because the control ob- 
jective is to achieve signal boundedness and regulation of the state x{t) to 
zero, the convergence of k{t) to k* is not crucial. 

Implementation The adaptive control scheme developed and analyzed 
above is given by the following equations: 



u 



-k{t)x, k = jeix = 7X , A;(0) = ko 



(6.2.14) 



where x is the measured state of the plant. A block diagram for implementing 
(6.2.14) is shown in Figure 6.2. 

The design parameters in (6.2.14) are the initial parameter k^ and the 
adaptive gain 7 > 0. For signal boundedness and asymptotic regulation of 
x to zero, our analysis allows A;o,7 to be arbitrary. It is clear, however, from 
(6.2.12) that their values affect the transient performance of the closed- loop 
plant as well as the steady-state value of the closed-loop pole. For a given 
kQ,xo / 0, large 7 leads to a larger value of c in (6.2.12) and, therefore, 
to a faster convergence of x(t) to zero. Large 7, however, may make the 
differential equation for k "stiff" (i.e., k large) that will require a very small 
step size or sampling period to implement it on a digital computer. Small 
sampling periods make the adaptive scheme more sensitive to measurement 
noise and modeling errors. 
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Remark 6.2.1 In the proceeding example, we have not used any reference 
model to describe the desired properties of the closed-loop system. A 
reasonable choice for the reference model would be 

which, by following exactly the same procedure, would lead to the 
adaptive control scheme 

u = —k{t)x, k = jeix 

where ei = x — Xm- If a^mO / xq, the use of (6.2.15) will affect the 
transient behavior of the tracking error but will have no effect on the 
asymptotic properties of the closed-loop scheme because Xm converges 
to zero exponentially fast. 

6.2.2 Scalar Example: Adaptive Tracking 

Consider the following first order plant: 

X = ax + hu (6.2.16) 

where a, h are unknown parameters but the sign of b is known. The control 
objective is to choose an appropriate control law u such that all signals in 
the closed-loop plant are bounded and x tracks the state Xm of the reference 
model given by 

Xm ^ CLmXm ~r Omf 

i.e., 

Xm = -^r (6.2.17) 

s + am 

for any bounded piecewise continuous signal r(t), where a^ > 0, bm are 
known and Xmit),r(t) are measured at each time t. It is assumed that 
am, bm and r are chosen so that Xm represents the desired state response of 
the plant. 

Control Law For x to track Xm for any reference input signal r(t), the 
control law should be chosen so that the closed-loop plant transfer function 
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from the input r to output x is equal to that of the reference model. We 
propose the control law 

u = -k*x + l*r (6.2.18) 

where k* , I* are calculated so that 

x{s) bl* bm Xmis) 



r(s) .s — a + bk* s + am r{s) 
Equation (6.2.19) is satisfied if we choose 



(6.2.19) 



r = ^, k* = ^^^ (6.2.20) 

provided of course that 6/0, i.e., the plant (6.2.16) is controllable. The 
control law (6.2.18), (6.2.20) guarantees that the transfer function of the 
closed-loop plant, i.e., ^ii|j is equal to that of the reference model. Such 
a transfer function matching guarantees that x(t) = Xm(t),yt > when 
a;(0) = Xm(0) or \x{t) — Xmit)\ —i- exponentially fast when x(0) 7^ Xm(0), 
for any bounded reference signal r(t). 

When the plant parameters a,b are unknown, (6.2.18) cannot be imple- 
mented. Therefore, instead of (6.2.18), we propose the control law 

u = -k{t)x + l{t)r (6.2.21) 

where k(t),l(t) is the estimate of k*,l*, respectively, at time t, and search 
for an adaptive law to generate k(t),l{t) on-line. 

Adaptive Law As in Example 6.2.1, we can view the problem as an on- 
line identification problem of the unknown constants k*,l*. We start with 
the plant equation (6.2.16) which we express in terms of k* , I* by adding and 
subtracting the desired input term —bk*x + bl*r to obtain 

X = —amX + bmV + b {k*x — l*r + u) 

i.e., 

x = — ^^— r+ {k*x-l*r + u) (6.2.22) 

Because Xm = gJ^ ^ ^^ ^ known bounded signal, we express (6.2.22) in terms 

2^ Xm,j I.e., 

{k*x-l*r + u) (6.2.23) 



of the tracking error defined as e = x — Xm, i-e. 



S + ttr, 
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Because b is unknown, equation (6.2.23) is in the form of the biUnear 
parametric model considered in Chapter 4, and may be used to choose an 
adaptive law directly from Table 4.4 of Chapter 4. 

Following the procedure of Chapter 4, the estimate e of e is generated as 

b{kx-lr + u) = (0) (6.2.24) 



■S + Urn S + a. 

where the last identity is obtained by substituting for the control law 

u = -k{t)x + l{t)r 

Equation (6.2.24) implies that the estimation error, defined as ei = e — e, 
can be simply taken to be the tracking error, i.e., ei = e, and, therefore, 
there is no need to generate e. Furthermore, since e is not generated, the 
estimate 6 of fc is not required. 

Substituting u = —k{t)x + l{t)r in (6.2.23) and defining the parameter 

errors k = k — k* ,1 = I — I* , we have 

b / ~ 

ei = e = —kx + Ir 

s + flm V 

or 

ei = —Qm^i + b ( — kx + Ir) , ei = e = x — Xm (6.2.25) 

As shown in Chapter 4, the development of the differential equation (6.2.25) 
relating the estimation error with the parameter error is a significant step 
in deriving the adaptive laws for updating k(t),l(t). We assume that the 
structure of the adaptive law is given by 

k = fiiei,x,r,u), / = /2 (ei, x,r, u) (6.2.26) 

where the functions /i, /2 are to be designed. 

As shown in Example 6.2.1, however, the use of the SPR-Lyapunov ap- 
proach without normalization allows us to design an adaptive law for k, I 
and analyze the stability properties of the closed-loop system using a single 
Lyapunov function. For this reason, we proceed with the SPR-Lyapunov ap- 
proach without normalization and postpone the use of other approaches that 
are based on the use of the normalized estimation error for later sections. 
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Consider the function 

V (euki) = i + ^\b\ + :^\b\ (6.2.27) 

V / 2 271 272 

where 71,72 > as a Lyapunov candidate for the system (6.2.25), (6.2.26). 
The time derivative V along any trajectory of (6.2.25), (6.2.26) is given by 

V = -a^e\ - bkeix + bkir + i^/i + i^/2 (6.2.28) 

71 72 

Because |6| = 6sgn(6), the indefinite terms in (6.2.28) disappear if we choose 
/i = 7i^ixsgn{b) , f2 = — 7261^ sgn(6). Therefore, for the adaptive law 

k = 7ieix sgn(fc), I = —7261?' sgn(6) (6.2.29) 

we have 

V = -amA (6.2.30) 

Analysis Treating Xm(t),r(i) in (6.2.25) as bounded functions of time, it 
follows from (6.2.27), (6.2.30) that y is a Lyapunov function for the third- 
order differential equation (6.2.25) and (6.2.29) where Xm is treated as a 
bounded function of time, and the equilibrium eie = Cg = 0, fee = 0, Ig = 
is U.S. Furthermore, ei,k,l £ £00 and ei £ £2- Because ei = e = x — Xm 
and Xm £ '^00, we also have x £ £00 and n e £00; therefore, all signals in 
the closed- loop are bounded. Now from (6.2.25) we have ei £ £00, which, 
together with ei £ £2, implies that ei{t) = e(t) ^ as i ^ 00. 

We have established that the control law (6.2.21) together with the adap- 
tive law (6.2.29) guarantee boundedness for all signals in the closed-loop 
system. In addition, the plant state x{t) tracks the state of the refer- 
ence model Xm asymptotically with time for any reference input signal r, 
which is bounded and piecewise continuous. These results do not imply 
that k{t) -^ k* and l(t) -^ I* as t ^ 00, i.e., the transfer function of the 
closed- loop plant may not approach that of the reference model as t ^ cx). 
To achieve such a result, the reference input r has to be sufficiently rich of 
order 2. For example, r(t) = sinwt for some w 7^ guarantees the expo- 
nential convergence of x(t) to Xm{i) and of k(t),l(t) to k*,l*, respectively. 
In general, a sufficiently rich reference input r(t) is not desirable especially 
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Figure 6.3 Block diagram for implementing the adaptive law (6.2.21) and 
(6.2.29). 

in cases where the control objective involves tracking of signals that are not 
rich in frequencies. Parameter convergence and the conditions the reference 
input r has to satisfy are discussed later on in this chapter. 
Implementation The MRAC control law (6.2.21), (6.2.29) can be im- 
plemented as shown in Figure 6.3. The adaptive gains 71,72 are designed 
by following similar considerations as in the previous examples. The ini- 
tial conditions /(O), A;(0) are chosen to be any a priori guess of the unknown 
parameters l*,k*, respectively. Small initial parameter error usually leads 
to better transient behavior. As we mentioned before, the reference model 
and input r are designed so that Xm describes the desired trajectory to be 
followed by the plant state. 



Remark 6.2.2 The assumption that the sign of b is known may be relaxed 
by using the techniques of Chapter 4 summarized in Table 4.4 and is 
left as an exercise for the reader (see Problem 6.3). 
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6.2.3 Vector Case: Full-State Measurement 

Let us now consider the nth order plant 

x = Ax + Bu, X e 7^" (6.2.31) 

where A e TZ'^^'^,B e -/^"x? are unknown constant matrices and {A,B) is 
controllable. The control objective is to choose the input vector u £ TZ'^ such 
that all signals in the closed-loop plant are bounded and the plant state x 
follows the state Xm G Tl"' of a reference model specified by the LTI system 

where Am G "JZ^^^ is a stable matrix, Bm £ "R-"^"^, and r £ TZ'^ is a bounded 
reference input vector. The reference model and input r are chosen so that 
Xmif) represents a desired trajectory that x has to follow. 

Control Law If the matrices A, B were known, we could apply the control 
law 

u = -K*x + L*r (6.2.33) 

and obtain the closed-loop plant 

x = (A-BK*)x + BL*r (6.2.34) 

Hence, if K* £ -/^gx" and L* £ TZ'^^'^ are chosen to satisfy the algebraic 
equations 

A - BK* = Am, BL* = Bm (6.2.35) 

then the transfer matrix of the closed- loop plant is the same as that of the ref- 
erence model and x(t) -^ Xm{i) exponentially fast for any bounded reference 
input signal r{t). We should note that given the matrices A,B,Am,Bm, 
no K*,L* may exist to satisfy the matching condition (6.2.35) indicating 
that the control law (6.2.33) may not have enough structural flexibility to 
meet the control objective. In some cases, if the structure of A, B is known, 
^m, Bm may be designed so that (6.2.35) has a solution for K* , L* . 

Let us assume that K*,L* in (6.2.35) exist, i.e., that there is sufficient 
structural flexibility to meet the control objective, and propose the control 
law 

u = -K{t)x + L{t)r (6.2.36) 
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where K(t),L(t) are the estimates of K*,L*, respectively, to be generated 
by an appropriate adaptive law. 

Adaptive Law By adding and subtracting the desired input term, namely, 
—B(K*x — L*r) in the plant equation and using (6.2.35), we obtain 

X = AmX + Bmv + B{K*x - L*r + u) (6.2.37) 

which is the extension of the scalar equation (6.2.22) in Example 6.2.2 to 
the vector case. Following the same procedure as in Section 6.2.2, we can 
show that the tracking error e = x — Xm and parameter error K = K — K* , 
L = L — L* satisfy the equation 

e = Arne + B{-kx + Lr) (6.2.38) 

which also depends on the unknown matrix B. In the scalar case we manage 
to get away with the unknown B by assuming that its sign is known. An 
extension of the scalar assumption of Section 6.2.2 to the vector case is as 
follows: Let us assume that L* is either positive definite or negative definite 
and r~^ = L*sgn(Z), where / = 1 if L* is positive definite and Z = — 1 if L* 
is negative definite. Then B = BmL*~^ and (6.2.38) becomes 

e = A^e + BmL*-^{-Kx + Lr) 

We propose the following Lyapunov function candidate 

V(e, k, L) = e^Pe + tr[k^rk + L'^TL] 

where P = P > satisfies the Lyapunov equation 

lAffi + A,^r = — (,/ 

for some Q = Q > 0. Then, 

V = -e^Qe + 2e^PBmL*-^(-kx + Lr) + 2tT[k^rk + L'^TL] 

Now 

e^PBraL*-^kx = ti[x'^k^rB^Pe]sgn{l) = ti[k^rB^Pex'^]sgn{l) 
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and 

e^ PBrr,L*-^Lr = tr[L^rS^Per^]sgn(0 

Therefore, for 

k = k = B^Pex'^sgn{l), L = L = -B^Per'^sgn{l) (6.2.39) 

we have 

V = -e^Qe 

Analysis From the properties of V, V, we estabhsh as in the scalar case 
that K(t),L(t),e(t) are bounded and that e(t) ^ as t ^ oo. 

Implementation The adaptive control scheme developed is given by 
(6.2.36) and (6.2.39). The matrix B^P acts as an adaptive gain matrix, 
where P is obtained by solving the Lyapunov equation PAm + AJ^^P = —Q 
for some arbitrary Q = Q > 0. Different choices of Q will not affect bound- 
edness and the asymptotic behavior of the scheme, but they will affect the 
transient response. The assumption that the unknown L* in the matching 
equation BL* = Bm is either positive or negative definite imposes an ad- 
ditional restriction on the structure and elements of B,Bm. Because B is 
unknown this assumption may not be realistic in some applications. 

The case where B is completely unknown is treated in [172] using the 
adaptive control law 

u= -L{t)K{t)x + L{t)r 

k = B^Pex'^, L = -LB^^eu^L (6.2.40) 

The result established, however, is only local which indicates that for stabil- 
ity K(0), 1/(0) have to be chosen close to the equilibrium Kg = K* , Lg = L* 
of (6.2.40). Furthermore, K*,L* are required to satisfy the matching equa- 
tions A - BL*K* = Arr„ BL* = Bm- 

6.2.4 Nonlinear Plant 

The procedure of Sections 6.2.1 to 6.2.3 can be extended to some special 
classes of nonlinear plants as demonstrated briefly by using the following 
nonlinear example 

X = af{x) + hg{x)u (6.2.41) 
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where a, b are unknown scalars, f(x),g(x) are known functions with g(x) > 
c > Vx e 7Z^ and some constant c > 0. The sgn(6) is known and /(x) 
is bounded for bounded x. It is desired that x tracks the state Xm of the 
reference model given by 

Xm ^ 0,mXm i 0ml" 

for any bounded reference input signal r. 

Control Law If a, b were known, the control law 

u= ^[k*J(x) + Kx + l*r] (6.2.42) 

9[x) 

with 

, * _ a _ am ,* _ bm 

ki- ^, k2- 5 ' ' - 5 

could meet the control objective exactly. For the case of a, b unknown, we 
propose a control law of the same form as (6.2.42) but with adjustable gains, 
i.e., we use 

[ki{t)f{x) + k2{t)x + l{t)r] (6.2.43) 



g{x 

where ki,k2,l, are the estimates of the unknown controller gains kl,k2,l* 
respectively to be generated by an adaptive law. 

Adaptive Law As in the previous examples, we first rewrite the plant 
equation in terms of the unknown controller gains /cj, /cg, /*, i.e., substituting 
for a = —bk\ and adding and subtracting the term h {k\f{x) + ^2^ + l*r) in 
(6.2.41) and using the equation bl* = bm,bk2 = —dm, we obtain 

X = —ttmX + bmT + b [—k\f{x) — k2X — l*r + g(x)u\ 

If we let e = X — Xm, ki = ki — kl, k2 = k2 — k2, 1 = I — I* to he the tracking 
and parameter errors, we can show as before that the tracking error satisfies 
the differential equation 

e = -ame + b [kif(x) + k2X + lr), ei = e 
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which we can use as in Section 6.2.2 to develop the adaptive laws 

ki = -7ie/(x) sgn(6) 

k2 = — 72ex sgn(6) (6.2.44) 

I = — 73er sgn(6) 

where 7j > 0,i = 1,2,3 are the adaptive gains. 

Analysis We can establish that all signals in the closed-loop plant (6.2.41), 
(6.2.43), and (6.2.44) are bounded and that \e(t)\ = \x(t) - Xm(t)| ^ as 
t ^ oo by using the Lyapunov function 

p2 L2 12 J2 

V{e,ki,~k2,l) = y + y^|6| + ;^|6| + —\b\ 
2 271 272 273 

in a similar way as in Section 6.2.2. The choice of the control law to cancel 
the nonlinearities and force the plant to behave as an LTI system is quite 
obvious for the case of the plant (6.2.41). Similar techniques may be used 
to deal with some more complicated nonlinear problems where the choice of 
the control law in the known and unknown parameter case is less obvious 
[105]. 

Remark 6.2.3 The simple adaptive control schemes presented in this sec- 
tion have the following characteristics: 

(i) The adaptive laws are developed using the SPR-Lyapunov design ap- 
proach and are driven by the estimation error rather than the normal- 
ized estimation error. The estimation error is equal to the regulation 
or tracking error that is to be driven to zero as a part of the control 
objective. 

(ii) The design of the adaptive law and the stability analysis of the closed- 
loop adaptive scheme is accomplished by using a single Lyapunov func- 
tion. 

(iii) The full state vector is available for measurement. 



Another approach is to use the procedure of Chapter 4 and develop adap- 
tive laws based on the SPR-Lyapunov method that are driven by normalized 
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estimation errors. Such schemes, however, are not as easy to analyze as the 
schemes with unnormahzed adaptive laws developed in this section. The 
reason is that the normalized estimation error is not simply related to the 
regulation or tracking error and additional stability arguments are needed 
to complete the analysis of the respective adaptive control scheme. 

The distinction between adaptive schemes with normalized and unnor- 
malized adaptive laws is made clear in this chapter by analyzing them in 
separate sections. Some of the advantages and disadvantages of normalized 
and unnormalized adaptive laws are discussed in the sections to follow. 

The assumption of full state measurement in the above examples is re- 
laxed in the following sections where we formulate and solve the general 
MRAC problem. 



6.3 MRC for SISO Plants 

In Section 6.2 we used several examples to illustrate the design and analysis 
of MRAC schemes for plants whose state vector is available for measurement. 
The design of MRAC schemes for plants whose output rather than the full 
state is available for measurement follows a similar procedure as that used 
in Section 6.2. This design procedure is based on combining a control law 
whose form is the same as the one we would use in the known parameter 
case with an adaptive law that provides on-line estimates for the controller 
parameters. 

In the general case, the design of the control law is not as straightforward 
as it appears to be in the case of the examples of Section 6.2. Because of 
this reason, we use this section to formulate the MRC problem for a general 
class of LTI SISO plants and solve it for the case where the plant parameters 
are known exactly. The significance of the existence of a control law that 
solves the MRC problem is twofold: First it demonstrates that given a set of 
assumptions about the plant and reference model, there is enough structural 
flexibility to meet the control objective; second, it provides the form of the 
control law that is to be combined with an adaptive law to form MRAC 
schemes in the case of unknown plant parameters to be treated in the sections 
to follow. 
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6.3.1 Problem Statement 

Consider the SISO, LTI plant described by the vector differential equation 

Xp — /i-pXp 'T' -DpUp^ XpyUJ — Xq 

yp Xp 



Vp = CJxp (6.3.1) 



where Xp G 7^"; yp, Up G TZ^ and Ap, Bp, Cp have the appropriate dimensions. 
The transfer function of the plant is given by 

(6.3.2) 









yp = 


Gp{ 


[.s)up 


with Gf 


^(s) 


expressed in 


the form 












Gp{s) 


~ 'Rpis) 



(6.3.3) 

where Zp,Rp are monic polynomials and kp is a constant referred to as the 
high frequency gain. 

The reference model, selected by the designer to describe the desired 
characteristics of the plant, is described by the differential equation 

Vra = C^Xm (6.3.4) 

where Xm G 7?.^™ for some integer Pm'-,ym-,f £ T^^ and r is the reference 
input which is assumed to be a uniformly bounded and piecewise continuous 
function of time. The transfer function of the reference model given by 

2/m = Wni{s)r 

is expressed in the same form as (6.3.3), i.e., 

Wm{s) = fcm|44 (6-3-5) 

Rm{s) 

where Zm{s),Rmis) are monic polynomials and km is a constant. 

The MRC objective is to determine the plant input Up so that all signals 
are bounded and the plant output yp tracks the reference model output ym 
as close as possible for any given reference input r(t) of the class defined 
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above. We refer to the problem of finding the desired Up to meet the control 
objective as the MRC problem. 

In order to meet the MRC objective with a control law that is imple- 
mentable, i.e., a control law that is free of differentiators and uses only 
measurable signals, we assume that the plant and reference model satisfy 
the following assumptions: 

Plant Assumptions 

PI. Zp(s) is a monic Hurwitz polynomial of degree nip 

P2. An upper bound n of the degree Up of Rp{s) 

P3. the relative degree n* = Up — nip of Gp(s), and 

P4. the sign of the high frequency gain kp are known 

Reference Model Assumptions: 

Ml. Zfn{s),Rmis) are monic Hurwitz polynomials of degree qm,Pm, 
respectively, where Pm < n. 

M2. The relative degree nj^ = pm — Qm of Wmis) is the same as that 
of Gp(s), i.e., n;^ = n*. 

Remark 6.3.1 Assumption PI requires the plant transfer function Gp{s) 
to be minimum phase. We make no assumptions, however, about the 
location of the poles of Gp{s), i.e., the plant is allowed to have unstable 
poles. We allow the plant to be uncontrollable or unobservable, i.e., 
we allow common zeros and poles in the plant transfer function. Be- 
cause, by assumption PI, all the plant zeros are in C~ , any zero-pole 
cancellation can only occur in C~ , which implies that the plant (6.3.1) 
is both stabilizable and detectable. 

The minimum phase assumption (PI) is a consequence of the control 
objective which is met by designing an MRC control law that cancels 
the zeros of the plant and replaces them with those of the reference 
model in an effort to force the closed-loop plant transfer function from 
r to ijp to be equal to Wmis). For stability, such cancellations should 
occur in C~ which implies that Zp(s) should satisfy assumption PI. 
As we will show in Section 6.7, assumptions P3, P4 can be relaxed at 
the expense of more complex control laws. 
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6.3.2 MRC Schemes: Known Plant Parameters 

In addition to assumptions PI to P4 and Ml, M2, let us also assume 
that the plant parameters, i.e., the coefficients of Gp(s) are known exactly. 
Because the plant is LTI and known, the design of the MRC scheme is 
achieved using linear system theory. 

The MRC objective is met if Up is chosen so that the closed-loop transfer 
function from r to yp has stable poles and is equal to Wmis), the transfer 
function of the reference model. Such a transfer function matching guaran- 
tees that for any reference input signal r(t), the plant output yp converges 
to ym exponentially fast. 

A trivial choice for Up is the cascade open-loop control law 

Up = C{s)r, Ci.s) = -^^^^-^ (6.3.6) 



which leads to the closed-loop transfer function 

W„,{s) (6.3.7) 



Up "'m ■^m ^p i^p^p 



V Kp iXra ^p ^p 

This control law, however, is feasible only when Rp{s) is Hurwitz. Other- 
wise, (6.3.7) may involve zero-pole cancellations outside C~, which will lead 
to unbounded internal states associated with non-zero initial conditions [95]. 
In addition, (6.3.6) suffers from the usual drawbacks of open loop control 
such as deterioration of performance due to small parameter changes and 
inexact zero-pole cancellations. 

Instead of (6.3.6), let us consider the feedback control law 

shown in Figure 6.4 where 

a{s) = a„_2(s) = [s"-2,s"-3,...,s,l]^ forn > 2 
a(s) = for n = 1 

Cq, 6^ e TZ^; 91,02 ^ TZ"'~^ are constant parameters to be designed and A(s) 
is an arbitrary monic Hurwitz polynomial of degree n—1 that contains Z^is) 
as a factor, i.e., 

A(s) = Aois)Z^{s) 
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Figure 6.4 Structure of the MRC scheme (6.3. 



which imphes that Ao(s) is monic, Hurwitz and of degree uq = n 
The controller parameter vector 



0* = \^ef,9f,ei,4Y e^^" 



is to be chosen so that the transfer function from r to yp is equal to Wmis). 
The I/O properties of the closed-loop plant shown in Figure 6.4 are 
described by the transfer function equation 



where 



Ge{s) 



Vp = Gc{s)i 



CQKpZpA 



A [(A - efa{s)) Rp - kpZp {9fa{s) + e*^A)] 



(6.3.9) 



(6.3.10) 



We can now meet the control objective if we select the controller param- 
eters 61,02,9^, Cg so that the closed-loop poles are stable and the closed-loop 
transfer function Gc{s) = Wm{s), i.e., 



CQKpZpA 



A [(A - 9fa) Rp - kpZp {0fa + ^^A)] 



fvn 



Rr, 



(6.3.11) 



is satisfied for all s e C. Because the degree of the denominator of Gc{s) is 
np + 2n — 2 and that of Rmis) is pm < n, for the matching equation (6.3.11) 
to hold, an additional rip + 2n — 2 — pm zero-pole cancellations must occur in 
Gc{s). Now because Zp(s) is Hurwitz by assumption and A(s) = Ao(s)Zm(s) 
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is designed to be Hurwitz, it follows that all the zeros of Gc{s) are stable 
and therefore any zero-pole cancellation can only occur in C~ . Choosing 

cS = ^ (6.3.12) 

and using A(s) = Ao(s)Zm(s) the matching equation (6.3.11) becomes 

(a - efa'j Rp - kpZp (^dfa + ^^a) = ZpAoRm (6.3.13) 



or 

9lMs)Rpis) + kp {efai.s) + 0;A(s)) Zp(s) = A(s)i?p(s) - Zp(s)Ao(s)i?„(s) 

(6.3.14) 
Equating the coefficients of the powers of s on both sides of (6.3.14), we can 
express (6.3.14) in terms of the algebraic equation 

Se* = p (6.3.15) 

where 0* = ^J^, 02^,^3 , 5 is an (n + rip - 1) x (2n - 1) matrix that 
depends on the coefficients of Rp, kpZp and A, and p is an n + np — 1 vector 
with the coefficients of ARp — ZpA^Rm- The existence of ^* to satisfy (6.3.15) 
and, therefore, (6.3.14) will very much depend on the properties of the matrix 
S. For example, if n > Up, more than one 9* will satisfy (6.3.15), whereas if 
n = Up and 5 is nonsingular, (6.3.15) will have only one solution. 



Remark 6.3.2 For the design of the control input (6.3.8), we assume that 
n > Hp. Because the plant is known exactly, there is no need to assume 
an upper bound for the degree of the plant, i.e., because Up is known 
n can be set equal to Up. We use n > n^ on purpose in order to use 
the result in the unknown plant parameter case treated in Sections 6.4 
and 6.5, where only the upper bound n for Up is known. 

Remark 6.3.3 Instead of using (6.3.15), one can solve (6.3.13) for 61,02,0^ 
as follows: Dividing both sides of (6.3.13) by Rp{s), we obtain 

A _ 0fa - kp^{0fa + 01A) = ZpIq + kp^] 

Up \ Up I 
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where Q{s) (of degree n— 1 — nip) is the quotient and kpA* (of degree 
at most Hp — 1) is the remainder of AoRm/Rp, respectively. Then the 
solution for 6*, i = 1, 2, 3 can be found by inspection, i.e., 

efa{s) = A(s) - Zp{s)Q{s) (6.3.16) 

Kp 

where the equality in the second equation is obtained by substituting 
for A*(s) using the identity "n "' = Q + ^ — . The parameters 6*,i = 
1,2,3 can now be obtained directly by equating the coefficients of the 
powers of s on both sides of (6.3.16), (6.3.17). 

Equations (6.3.16) and (6.3.17) indicate that in general the controller 
parameters 6*,i = 1,2,3 are nonlinear functions of the coefficients of 
the plant polynomials Zp{s), Rp{s) due to the dependence of Q(s) on 
the coefficients of Rp(s). When n = Up and n* = 1, however, Q{s) = 1 
and the ^*'s are linear functions of the coefficients of Zp(s), Rp{s). 

Lemma 6.3.1 Let the degrees of Rp, Zp, A, Aq and Rm be as specified in 
(6.3.8). Then (i) The solution 6* of (6.3.14) or (6.3.15) always exists. 
(ii) In addition if Rp, Zp are coprime and n = Up, then the solution 9* is 
unique. 

Proof Let Rp = Rp{s)h{s) and Zp{s) = Zp{s)h{s) and Rp{s), Zp{s) be coprime, 
where h{s) is a nionic polynomial of degree tq (with < tq < nip). Because Zp{s) 
is Hurwitz, it follows that h{s) is also Hurwitz. If Rp, Zp are coprime, h{s) = 1, i.e., 
rg = 0. If -Rp, Zp are not coprime, tq > 1 and h{s) is their common factor. We can 
now write (6.3.14) as 

e*JaRp + kp{6*^a + 6lA)Zp = ARp - ZpAoRm (6.3.18) 

by canceling h{s) from both sides of (6.3.14). Because h{s) is Hurwitz, the cancella- 
tion occurs in C^ . Equation (6.3.18) leads to rip + n — Tq — 2 algebraic equations with 
2n— 1 unknowns. It can be shown that the degree of ARp — ZpAoRm is np + n—rQ — 2 
because of the cancellation of the term 5"p+"-''()-i. Because Rp,Zp are coprime, 
it follows from Theorem 2.3.1 that there exists unique polynomials ao{s),bo{s) of 
degree n — 2, rip — rg — 1 respectively such that 

ao{s)Rp{s) + bo{s)Zp{s) = A{s)Rp{s) - Zp{s)Ao{s)R„^{s) (6.3.19) 
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is satisfied for n > 2. It now follows by inspection that 

e*Ja{s) = f{s)Zp{s) + ao(s) (6.3.20) 

and 

kp{efa{.s) + 9;A{s)) = -f{.s)Rp{s) + bo{s) (6.3.21) 

satisfy (6.3.18), where f{s) is any given polynomial of degree Uf = n — np + vq — I. 
Hence, the solution 91,62,0^ of (6.3.18) can be obtained as follows: We first solve 
(6.3.19) for ao(s),6o(s). We then choose an arbitrary polynomial f{s) of degree 
Uf = n — Hp + tq — I and calculate 61,02,0^ from (6.3.20), (6.3.21) by equating 
coefficients of the powers of s. Because f{s) is arbitrary, the solution 91,62,0^ is 
not unique. If, however, n = Hp and rg = 0, i.e., Rp, Zp are coprime, then f{s) = 
and 61^ a{s) = ao(s), fcp(02^Q:(s) + 9'^A{s)) = bo{s) which implies that the solution 
91,02,9^ is unique due to the uniqueness of ao(s),6o(s). If n = rip = 1, then 
a{s) = 0, A(s) = I, 91 = 9^ = and 9^ given by (6.3.18) is unique. D 



Remark 6.3.4 It is clear from (6.3.12), (6.3.13) that the control law (6.3.8) 
places the poles of the closed-loop plant at the roots of the polynomial 
Zp{s)Ao(s)Rm{s) and changes the high frequency gain from kp to km 
by using the feedforward gain Cq. Therefore, the MRC scheme can be 
viewed as a special case of a general pole placement scheme where the 
desired closed-loop characteristic equation is given by 

Zp{s)Ao{s)Rm{s) = 

The transfer function matching (6.3.11) is achieved by canceling the 
zeros of the plant, i.e., Zp(s), and replacing them by those of the 
reference model, i.e., by designing A = AqZ^ti- Such a cancellation 
is made possible by assuming that Zp(s) is Hurwitz and by designing 
Aq, Zjn to have stable zeros. 

We have shown that the control law (6.3.8) guarantees that the closed- 
loop transfer function Gc{s) of the plant from r to i/p has all its poles in C~ 
and in addition, Gc{s) = Wmis). In our analysis we assumed zero initial 
conditions for the plant, reference model and filters. The transfer function 
matching, i.e., Gc{s) = Wmis), together with zero initial conditions guar- 
antee that yp{t) = ymit),yt > and for any reference input r(t) that is 
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bounded and piecewise continuous. The assumption of zero initial condi- 
tions is common in most I/O control design approaches for LTI systems and 
is valid provided that any zero-pole cancellation in the closed-loop plant 
transfer function occurs in C~ . Otherwise nonzero initial conditions may 
lead to unbounded internal states that correspond to zero-pole cancellations 
inC+. 

In our design we make sure that all cancellations in Gc{s) occur in C~ 
by assuming stable zeros for the plant transfer function and by using stable 
filters in the control law. Nonzero initial conditions, however, will affect the 
transient response of yp{t). As a result we can no longer guarantee that 
yp{t) = ym{i) Vi > but instead that yp{t) -^ ym{t) exponentially fast with 
a rate that depends on the closed- loop dynamics. We analyze the effect of 
initial conditions by using state space representations for the plant, reference 
model, and controller as follows: We begin with the following state-space 
realization of the control law (6.3.8): 



(6.3.22) 



Wl = 


= Fuji + gup, 


c^i(O) 


= 


0J2 = 


= Fuj2 + gyp, 


CJ2(0) 


= 



3*T, 



where uJi,u)2 £ Tl 



n-l 



)f,i 



1*T n* „* 
2 ' '^a ' "^0 



, w = [ujj,ujj,yp,r 



-An-2 
1 




-An-3 



1 





Aj are the coefficients of 



-An-4 






-Ao 







1 




(6.3.23) 



Ms) 



+ A„-2s" ^ + . . . + Ais + Ao = det(s/ - F) 



and {F,g) is the state space realization of X7~T' ^•^•' ^^^ ~ ^) ^9 



A(s)- 






The 



block diagram of the closed-loop plant with the control law (6.3.22) is shown 
in Figure 6.5. 
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Figure 6.5 Block diagram of the MRC scheme (6.3.22). 



We obtain the state-space representation of the overall closed-loop plant 
by augmenting the state Xp of the plant (6.3.1) with the states uji,uj2 of the 
controller (6.3.22), i.e., 



Y, = A,Y, + B,clr, YM = Yo 



CjY, 



(6.3.24) 



where 



A, 



Y,= [xl,i0j,u:lY e7e"-+2n-2 



Ap + BpOlCp 

gdlCp 
9CI 



npUi 



Opt) 2 



F + gef gef 



'2 

F 



Br 



Bp 

g 





(6.3.25) 



cj=[cj, 0,0] 

and Yq is the vector with initial conditions. We have already established 
that the transfer function from r to yp is given by 

Vpis) _ 



CQKpZpA 
r{s) A [(A - efa) Rp - kpZp (Of a + O^A)] 

which implies that 



VFm(s) 



Cj (.sI - A,)-' B,cl 



CQKpZpA 



A [(A - efa) Rp - kpZp (6 fa + e*^A)] 



Wm{s) 
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and, therefore, 

det {si -Ac) = A [(a - efaj Rp - kpZp (of a + ^gA)] = AZpAoRm 

where the last equahty is obtained by using the matching equation (6.3.13). 
It is clear that the eigenvalues of Ac are equal to the roots of the polynomials 
A, Zp and Rm', therefore, Ac is a stable matrix. The stability of Ac and the 
boundedness of r imply that the state vector Yc in (6.3.24) is bounded. 

Since Cj {si — Ac)~^BcCq = Wm{s), the reference model may be realized 
by the triple {Ac,BcCq,Cc) and described by the nonminimal state space 
representation 

J^^m = AcYm + BcCqT, ¥^[0) = YmO 

Vm = ClYra (6.3.26) 

where Ym e 7e"p+2"-2. 

Letting e = Yc — Ym to be the state error and ei = yp — ym the output 
tracking error, it follows from (6.3.24) and (6.3.26) that 

e = Ace, ei = Cc e 

i.e., the tracking error ei satisfies 

ei = Cje^^* {Yc{0) - F^(0)) 

Because Ac is a stable matrix, ei{t) converges exponentially to zero. The 
rate of convergence depends on the location of the eigenvalues of Ac, which 
are equal to the roots of A{s)AQ{s)Rm{s)Zp{s) = 0. We can affect the rate 
of convergence by designing A{s)Aq{s) Rm{s) to have fast zeros, but we are 
limited by the dependence of Ac on the zeros of Zp{s), which are fixed by 
the given plant. 

Example 6.3.1 Let us consider the second order plant 

_ -2(s + 5) _ -2(s + 5) 
yp - s^-2s+l'''' ~ {s-lf "'^ 

and the reference model 

3 

s + 3 
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The order of the plant is rip = 2. Its relative degree n* = 1 is equal to that of the 
reference model. 

We choose the polynomial A(s) as 



A(s) = s+l = Ao(s) 



and the control input 



1 



%„ = 9t u. 

P ^s+1 ■ 



1 



p ^ "2 



S+l 



Vp + ff^Vp + Co?- 



which gives the closed-loop transfer function 

Vp _ -2c5(s + 5)(s+l) 



r (s + 1 - 6**) (s - ly + 2 (s + 5) (6** + 6»* (s + 1)) 



Gc{s) 



Forcing Gc{s) = 3/(s + 3), we have Cg = —3/2 and the matching equation (6.3.14) 
becomes 

ei [s -if -2 {e; + 9l{s+ l)) (s + 5) = (s + l) (s - l)^ - (s + 5) (s + 1) (s + 3) 



{dl - 261) s^ + (-2^1 - 26^2 - 12^3) S + 61-IQ {6^ + 01) = -lOs^ - 24s - 14 
Equating the powers of s we have 

61-261 = -10 
61 + 6*2+ 6^3 = 12 
61 - 10^2 - 10^3 = -14 



1 -2 

1 1 6 

1 -10 -10 





\6; 1 




-10 " 




e* 


= 


12 




L^3 J 




-14 



which gives 



The control input is therefore given by 

1 1 

-4 Ur, - 2 



61 -4 

0*2 = -2 

. ^3 . . 3 _ 



'P- ^s + l" s 



jVp + 3yp - 1.5r 



and is implemented as follows: 

Wi = -Wi + Up, W2 = -^2 + Vp 



-4wi — 2w2 + ^Vp — l-5r 



V 
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Gp{s) 



I 



(si - F)-i 



^(^1 



Vv 



6% 



I 



(s/-F)-i 



0J2 



0*3 



Figure 6.6 Implementation of the MRC scheme (6.3.28). 



Remark 6.3.5 Because 6* is a constant vector, the control law (6.3.8) may 
be also written as 



Uv 



A(s 
and implemented as 



"^^'^ (Olup) + ^ {e*,yp) + eiy, + clr (6.3.27) 



A(s) 



LOi = F uJi + 6\up 
F'^uj2 + Olvp 



L02 



(6.3.28) 



■p -= g^ui + g^uj2 + Olyp + clr 



where uji,uj2 £ "^^ J -^)5 are as defined in (6.3.23), i.e., g (si — 
F^)~^ = g'^ {{si — F)~^)'^ = \u\ . The block diagram for implement- 
ing (6.3.28) is shown in Figure 6.6. 

Remark 6.3.6 The structure of the feedback control law (6.3.8) is not 
unique. For example, instead of the control law (6.3.8) we can also 
use 



3*T «('5) „, , Q*T "(«) 



Ai(^; 



u„ + 6t 



Ai(.) 



Vp + CqV 



(6.3.29) 
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where Ai(s) = AQ{s)Zm{s) has degree n,a{s) = a„_i(s) = [s^~^, 
s^~'^, . . ., s, 1] and 91, 62 G "Z^"- The overall desired controller param- 
eter 6* = ki^,^2^,CQ e 7?,^"-+^ has one dimension more than that 
in (6.3.8). The analysis of (6.3.29) is very similar to that of (6.3.8) and 
is left as an exercise (see Problem 6.7) for the reader. 

Remark 6.3.7 We can express the control law (6.3.8) in the general feed- 
back form shown in Figure 6.7 with a feedforward block 



A{s) - ei ' a{s) 
and a feedback block 

efa{s) + 6'_^A(s) 



Hs) 



HsH 



where Cq,01,62, 91 are chosen to satisfy the matching equation (6.3.12), 
(6.3.13). The general structure of Figure 6.7 allows us to analyze and 
study properties such as robustness, disturbance rejection, etc., of the 
MRC scheme using well established results from linear system theory 

[57, 95]. 

We have shown that the MRC law (6.3.8), whose parameters 9*,i = 1,2,3 
and Cq are calculated using the matching equations (6.3.12), (6.3.13) meets 
the MRC objective. The solution of the matching equations for 9* and Cg 
requires the knowledge of the coefficients of the plant polynomials kpZp(s), 
Rp{s). In the following sections we combine the MRC law (6.3.8) with an 
adaptive law that generates estimates for 9* , Cg on-line to deal with the case 
of unknown plant parameters. 

6.4 Direct MRAC with Unnormalized Adaptive 
Laws 

The main characteristics of the simple MRAC schemes developed in Section 
6.2 are 

(i) The adaptive laws are driven by the estimation error which, due to the 
special form of the control law, is equal to the regulation or tracking 
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>(y^ 


Cis) 


Up 


Gpis) 


Vp 


+T 


^ 




















F{s) 



















Figure 6.7 MRC in the general feedback block diagram where C{s) 



A(s)-6»*Tq(s)' 



=S^{s) 



error. They are derived using the SPR-Lyapunov design approach 
without the use of normalization 



(ii) A simple Lyapunov function is used to design the adaptive law and 
establish boundedness for all signals in the closed- loop plant. 

The extension of the results of Sections 6.2, 6.3 to the SISO plant (6.3.1) 
with unknown parameters became an active area of research in the 70's. 
In 1974, Monopoli [150] introduced the concept of the augmented error, a 
form of an estimation error without normalization, that he used to develop 
stable MRAC schemes for plants with relative degree 1 and 2, but not for 
plants with higher relative degree. Following the work of Monopoli, Feuer 
and Morse [54] designed and analyzed MRAC schemes with unnormalized 
adaptive laws that are applicable to plants with known relative degree of ar- 
bitrary positive value. This generalization came at the expense of additional 
complexity in the structure of MRAC schemes for plants with relative de- 
gree higher than 2. The complexity of the Feuer and Morse MRAC schemes 
relative to the ones using adaptive laws with normalized estimation errors, 
introduced during the same period [48, 72, 174], was responsible for their 
lack of popularity within the adaptive control research community. As a 
result, it was not until the early 1990s that the MRAC schemes designed 
for plants with relative degree higher than 2 and employing unnormalized 
adaptive laws were revived again and shown to offer some advantages over 
the MRAC with normalization when applied to certain classes of nonlinear 
plants [98, 116, 117, 118, 162]. 

In this section, we follow an approach very similar to that of Feuer and 
Morse and extend the results of Section 6.2 to the general case of higher 
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order SISO plants. The complexity of the schemes increases with the relative 
degree n* of the plant. The simplest cases are the ones where n* = 1 and 2. 
Because of their simplicity, they are still quite popular in the literature of 
continuous-time MRAC and are presented in separate sections. 

6.4.1 Relative Degree n* = 1 

Let us assume that the relative degree of the plant 

Vp = Gp{s)up = kp J Up (6.4.1) 

Kp{s) 

is n* = 1. The reference model 

Vm = Wm{s)r 

is chosen to have the same relative degree and both Gp(s),Wmis) satisfy 
assumptions PI to P4, and Ml and M2, respectively. In addition Wmis) is 
designed to be SPR. 

The design of the MRAC law to meet the control objective defined in 
Section 6.3.1 proceeds as follows: 

We have shown in Section 6.3.2 that the control law 

LOi = FuJi+gUp, a;i(0) = 

W2 = Fuj2 + gyp, cd2(0) = (6.4.2) 

Up = a to 

where uj =\ojI ,UJ2 ,yp,r\ , and 9* = W^^ ,9^^ ,91,c*q\ calculated from the 
matching equation (6.3.12) and (6.3.13) meets the MRC objective defined in 
Section 6.3.1. Because the parameters of the plant are unknown, the desired 
controller parameter vector 9* cannot be calculated from the matching equa- 
tion and therefore (6.4.2) cannot be implemented. A reasonable approach 
to follow in the unknown plant parameter case is to replace (6.4.2) with the 
control law 

ioi = FuJi+gUp, a;i(0) = 

^2 = FL02 + 9yp, UJ2{0) = (6.4.3) 

U„ = 9 U! 
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where 9(t) is the estimate of 9* at time t to be generated by an appropri- 
ate adaptive law. We derive such an adaptive law by following a similar 
procedure as in the case of the examples of Section 6.2. We first obtain a 
composite state space representation of the plant and controller, i.e., 



Ye 
Ur, 



AoYe + BeUp, Yc{0) = Yo 
CjY, 



where "K. 



cj,^7>< 



c 



Ap 

F 

gCJ 



Cj,0,0 





F 



Br 



Bp 

9 




and then add and subtract the desired input BcO* uj to obtain 



*T, 



Y, = A^Y, + B.e* ' uj + B, 



e 



*T, 



If we now absorb the term B^O u> into the homogeneous part of the above 
equation, we end up with the representation 



Yc 
Vp 



AcYc + B^clr + B, 



c<-0' 



Ur, 



Q*T 



UJ 



YM = Fo 



CjYr 



(6.4.4) 



where A^ is as defined in (6.3.25). Equation (6.4.4) is the same as the closed- 
loop equation (6.3.24) in the known parameter case except for the additional 
input term Bc{up — 9*~^co) that depends on the choice of the input Up. It 
serves as the parameterization of the plant equation in terms of the desired 
controller parameter vector 9* . Let e = Y^ — Y^ and ei = i/p — ym where Y^ 
is the state of the nonminimal representation of the reference model given 
by (6.3.26), we obtain the error equation 



e 
ei 



Ace + Bciup 
Cje 



3*T 



e* ' uj), e(0) = eo 



(6.4.5) 
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Because 

CjisI-A,)-^B,c*o = Wm{s) 

we have 

ei = Wm{s)p* (up - r^cj) (6.4.6) 

where p* = —, which is in the form of the bihnear parametric model analyzed 
in Chapter 4. We can now use (6.4.6) to generate a wide class of adaptive 
laws for estimating 9* by using the results of Chapter 4. We should note 
that (6.4.5) and (6.4.6) hold for any relative degree and will also be used in 
later sections. 

The estimate ei(t) of ei(t) based on 9{t), the estimate of 9* at time t, is 
given by 

ei = Wm{s)p {up - 9^Lu) (6.4.7) 

where p is the estimate of p* . Because the control input is given by 



aT 



(t)^ 



it follows that ei = iym(s)[0]; therefore, the estimation error ei defined in 
Chapter 4 as ei = ei — ei may be taken to be equal to ei, i.e., ei = ei. 
Consequently, (6.4.7) is not needed and the estimate p of p* does not have 
to be generated. Substituting for the control law in (6.4.5), we obtain the 
error equation 

e = AcC + BcP*9~^Ld, e(0) = cq 
ei = Cje (6.4.8) 



where 



or 



Be — BcCq 



ei = Wmis)p*9^u; 



which relates the parameter error 9 = 9{t) — 9* with the tracking error ei. 
Because Wm{s) = Cj {sl — Ac)~^BcCq is SPR and Ac is stable, equation 
(6.4.8) is in the appropriate form for applying the SPR-Lyapunov design 
approach. 
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We therefore proceed by proposing the Lyapunov-hke function 

where T = F^ > and Pc = Pj > satisfies the algebraic equations 
PcAc + AJPc = -qq^ -VcLc 

^cJ^c ^ Cc 

where g is a vector, L^ = LJ > and t'c > is a small constant, that are 
implied by the MKY lemma. The time derivative V of V along the solution 
of (6.4.8) is given by 

V = _^I^ _ |e^Lee + e'^P,B,p*e'^co + e'^r-%*\ 

Because e PcBc = ei and p* = \p*\sgn{p*), we can make F < by choosing 

e = e = -Teiuj sgn(p*) (6.4.10) 

which leads to 

V= ^ —e Lee (6.4.11) 

Equations (6.4.9) and (6.4.11) imply that V and, therefore, e,6 ^ Coo- 

Because e = Yc — Ym and Y^ G /3oo, we have Yc G Coo, which implies that 
yp,uJi,L02 £ Coo- Because Up = 6'^ to and 6,lo ^ Coo we also have Up e -Coo- 
Therefore all the signals in the closed-loop plant are bounded. It remains to 
show that the tracking error ei = yp — y-m goes to zero as t ^ oo. 

From (6.4.9) and (6.4.11) we establish that e and therefore ei £ C2- 
Furthermore, using 6,uJ,e G £00 in (6.4.8) we have that e, ei G £00. Hence, 
ei,ei G £00 and ei G C2, which, by Lemma 3.2.5, imply that ei(t) ^ as 
t -^ 00. 

We summarize the main equations of the MRAC scheme in Table 6.1. 

The stability properties of the MRAC scheme of Table 6.1 are given by 
the following theorem. 



Theorem 6.4.1 The MRAC scheme summarized in Table 6.1 guarantees 
that: 
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Table 6.1 MRAC scheme: n* = 1 



Plant 


yp — '^PRp(s)^P^ n — 1 


Reference 
model 


ym = W^{s)r, Wm{s)=k^§^ 


Control law 


uJi = Fuji + gUp, uJi{0) = 

U!2 = Fui2 + gyp, UJ2{0)=0 

Up = 6'^uj 

CO = [uj,ujj,yp,r]'^,uji e 7^"-^ uj2 G 7^"-l 


Adaptive law 


= -TeiLO sgn(p*) 

ei = yp - Vm, sgn(p*) = sgn{kp/km) 


Assumptions 


Zp,Rp and Wm{s) satisfy assumptions PI to P4, 
and Ml and M2, respectively; Wm{s) is SPR; {sl - 
F)-'g = ^,a(s) = [s-2,s-3,...s,l]T, where 
A = h.QZm is Hurwitz, and Ao(s) is of degree n—l—qm, 
Qm is the degree of Zm{s); P = P^ > is arbitrary 



(i) All signals in the closed-loop plant are bounded and the tracking error 
ei converges to zero asymptotically with time for any reference input 
r e Coo- 

(ii) If r is sufficiently rich of order 2n,r G Coo o-nd Zp(s),Rp(s) are rela- 
tively coprime, then the parameter error \9\ = \9 — 9*\ and the tracking 
error ei converge to zero exponentially fast. 

Proof (i) This part has already been completed above. 

(ii) Equations (6.4.8) and (6.4.10) have the same form as (4.3.30) and (4.3.35) 
with rig = in Chapter 4 whose convergence properties are established by Corollary 
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4.3.1. Therefore, by using the same steps as in the proof of Corollary 4.3.1 we can 
establish that if w, w € Coo and iv is PE then 0{t) —> exponentially fast. If r G C^o 
then it follows from the results of part (i) that w G Coo- For the proof to be 
complete, it remains to show that uj is PE. 
We express uj as 



CO 



{sI-F)-^gG„\s)yp 
{sI-F)-^gyp 



r 



Because 2/p = j/m + ei = Wm{s)r + ei we have 



(6.4.12) 



(6.4.13) 



where 
and 



H{.s) 



UJra = H{s)r, 

{sI-F)-^gG-^is)Wmis) 
{si - F)-^gWm{s) 

Wra{s) 
1 



Ho{s)ei 



Ho{s) 



{sI-F)-'gG-Hs) 

{sI-Fr^g 

1 





The vector uj is the output of a proper transfer matrix whose poles are stable and 
whose input ei G £2 l~l Coo and goes to zero as f — > c». Hence, from Corollary 3.3.1 
we have cD G £2 l~l Coo and \uj{t)\ —> as t —> 00. It then follows from Lemma 4.8.3 
that UJ is PE if ujm is PE. 

It remains to show that uJm is PE when r is sufficiently rich of order 2n. 

Because r is sufficiently rich of order 2n, according to Theorem 5.2.1, we can 
show that uJm is PE by proving that H{juJi), H[juj2), • . • , H{juj2n) are linearly in- 
dependent on C^" for any oji, (jJ2, • • • , ^2n G TZ with uji 7^ ujj for i ^ j. 

From the definition of H{s), we can write 



H{s) 



kpZp{s)A{s)Rm{s) 



kpZp{s)A{s)Rm{t 



:Hiis) 



a{s)Rp{s)kmZmis) 
a{s)kpZp{s)kjnZm{s) A 

A(S)kpZp[s)kmZm{sj 

K{s)kpZp{s)Rm{s) 

(6.4.14) 
Because all the elements of -ffi(s) are polynomials of s with order less than or equal 
to that oi K{s)Zp{s)Rm{s), we can write 

" s' - 
iJi(s) = H . (6.4.15) 
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where I = 2n — I + Qm is the order of the polynomial A{s) Zp{s) Rm{s) , q-m is the 
degree of Z„i{s) and H G 7^2nx(i+i) jg ^^ constant matrix. 

We now prove by contradiction that H in (6.4.15) is of full rank, i.e., rank{H) = 
2n. Suppose rank{H) < 2n, i.e., there exists a constant vector C G TZ^" with C 7^ 
such that 








or equivalently 

C'Hi{s) = (6.4.16) 

for all s e C. Let C = [Cj ,Cj ,03,0^^ , where Ci,C2 G 7e"-\ 03,04 e Te^, then 
(6.4.16) can be written as 



Cj a{s)Rp{s)k^Zm{s) + Cj a{s)kpZp{s)kmZjn{s) 

+C3A{s)kpZp{s)kmZm{s) + C4A{s)Rm{s)kpZp{s) = 



(6.4.17) 



Because the leading coefficient of the polynomial on the left hand side is C4, for 
(6.4.17) to hold, it is necessary that C4 = 0. Therefore, 

[Cja{s)Rp{s) + Cj a{s)kpZp{s) + C3A{s)kpZp{s)]kmZm{s) = 

or equivalently 

Cja{s)Rp{s) + Cj a{s)kpZp{s) + C3A{s)kpZp{s) = (6.4.18) 

Equation (6.4.18) implies that 

Zp{s) _ C^a{s) 



kr, 



Rp{s) c-iA{s) + Cja{s) 



(6.4.19) 



Noting that C3A(s) + C2 oi[s) is of order at most equal to n— 1, (6.4.19) contradicts 
our assumption that Zp{s), Rp{s) are coprime. Therefore H must be of full rank. 



Now consider the 2n x 2n matrix L{uji, . . . ,LU2n 
Using (6.4.14) and (6.4.15), we can express L{uji,uj2, 



A 



,^2«) as 



,HU^2n)]- 



L{uji 



,^2r. 



H 
















j-i 



(j^2n)' 



1 


1 

D(JUJ2) 









1 



(6.4.20) 
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where D{s) = kpZp{s)K{s)Rm{s). Note that the matrix in the middle of the right- 
hand side of (6.4.20) is a submatrix of the Vandermonte matrix, which is always 
nonsingular for LOi ^ iOk,i ^ k\i,k = l,...,2n. We, therefore, conclude from 
(6.4.20) that L{loi, . . . ,u;2ti) is of full rank which implies that H[JLOi), . . . , H[juj2n) 
are linearly independent on C^" and the proof is complete. □ 



Example 6.4.1 Let us consider the second order plant 

_ kp{s + bp) 
{s-^ + aiS + aQ) 

where fcp > 0,6o > s-nd kp,bp,ai,ap are unknown constants. The desired perfor- 
mance of the plant is specified by the reference model 

1 

Vm = 



s+1 
Using Table 6.1, the control law is designed as 

Wi = —2uJi + Up, uJi{0) = 

UJ2 = -2uJ2 + yp, CJ2(0)=0 

Up = diuji + 02UI2 + OzVp + Cor 
by choosing F = —2,g= 1 and A(s) = s -|- 2. The adaptive law is given by 

e = -Teiuj, e{0) = 6*0 

where ei = j/p — t/m,^ = [^i, ^2, ^3, cq] and cu = [uji,uj2,yp,r] . We can choose 
r = diag{7j} for some 7^ > and obtain the decoupled adaptive law 

0i = -jieiuji, i = l,...,4 

where 64 = CojUj^ = yp,uJ4^ = r; or we can choose T to be any positive definite 
matrix. 

For parameter convergence, we choose r to be sufficiently rich of order 4. 
As an example, we select r = Aisvauit -\- A2SvaL02t for some nonzero constants 
Ai, A2,LOi,t02 with LOi ^ L02. Wc should emphasize that we may not always have 
the luxury to choose r to be sufficiently rich. For example, if the control objective 
requires r =constant in order for yp to follow a constant set point at steady state, 
then the use of a sufficiently rich input r of order 4 will destroy the desired tracking 
properties of the closed-loop plant. 

The simulation results for the MR AC scheme for the plant with 69 = 3, ai = 3, 
ao = —10, fcp = 1 are shown in Figures 6.8 and 6.9. The initial value of the 
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(b) 

Figure 6.8 Response of the MRAC scheme for Example 6.4.1 with r(t) = 
unit step function. 



parameters are chosen as 6(0) = [3, —10, 2, 3]^. Figure 6.8(a, b) shows the response 
of the tracking error ei and estimated parameter error 6i for 7, = 1 and r = unit 
step . Figure 6.9 shows the simulation results for F = diag{2, 6, 6, 2} and r = 
0.5sin0.7i + 2cos5.9i. From Figure 6.9 (b), we note that the estimated parameters 
converge to 9* = [1, —12, 0, 1]^ due to the use of a sufficiently rich input. V 



Remark 6.4.1 The error equation (6.4.8) takes into account the initial con- 
ditions of the plant states. Therefore the results of Theorem 6.4.1 hold 



354 



CHAPTER 6. MODEL REFERENCE ADAPTIVE CONTROL 




200sec 




20 40 60 80 100 120 140 160 180 200sec 

(b) 

Figure 6.9 Response of the MRAC scheme for Example 6.4.1 with r(t) = 
0.5sin0.7t + 2cos5.9t. 

for any finite initial condition for the states of the plant and filters. 
In the analysis, we implicitly assumed that the nonlinear differential 
equations (6.4.8) and (6.4.10) with initial conditions e(0) = eo,9(0) = 
6q possess a unique solution. For our analysis to be valid, the solution 
6(t),e(t) has to exist for all t e [0,oo). The existence and uniqueness 
of solutions of adaptive control systems is addressed in [191]. 

Remark 6.4.2 The proof of Theorem 6.4.1 part (i) may be performed by 
using a minimal state-space representation for the equation 



ei = Wm{s)p*9^oj 



(6.4.21) 



id 
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rather than the nonminimal state representation (6.4.8) to develop the 
adaptive law 9 = — Feiw. In this case we establish that ei, £ £oo and 
ei e C2 by using the LKY ( instead of the MKY Lemma ) and the 
properties of a Lyapunov-like function. The boundedness of ei implies 
that yp e £00 • 

The boundedness of cu and the rest of the signals requires the following 
additional arguments: We write uj as 

{sl - F)-^gG-Hs)yp 
{si -F)-^ gyp 

Vp 
r 

Because yp e £00 and (s/ — F)~^gGp^{s), {sl — F)~^g are proper 
(note that the relative degree of Gp(s) is 1) with stable poles, we have 
oj e Coo- From Up = 9^ uj and 9,ijj ^ Coo, it follows that Up e Coo- 
The proof of ei(t) ^ as t ^ 00 follows by applying Lemma 3.2.5 and 
using the properties ei £ £2, ei = sWm{s)p*u u) £ £oo- 

Remark 6.4.3 The effect of initial conditions may be accounted for by 
considering 

ei = Wm{s)p*¥u + ClisI - AJ-ie(O) 

instead of (6.4.21). Because the term that depends on e(0) is exponen- 
tially decaying to zero, it does not affect the stability results. This can 
be shown by modifying the Lyapunov-like function to accommodate 
the exponentially decaying to zero term (see Problem 6.19). 

6.4.2 Relative Degree n* = 2 

Let us consider again the parameterization of the plant in terms of 9* , de- 
veloped in the previous section, i.e.. 



^*^CJ 



e = Ace + Be (up - 9* 
ei = Cje (6.4.22) 
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or 

ei = Wrr,{s)p* (up - e*^uj^ (6.4.23) 

In the relative degree n* = 1 case, we are able to design Wmis) to be SPR 
which together with the control law Up = O'^u) enables us to obtain an error 
equation that is suitable for applying the SPR-Lyapunov design method. 

With n* = 2, Wmis) can no longer be designed to be SPR and therefore 
the procedure of Section 6.4.1 fails to apply here. 

Instead, let us follow the techniques of Chapter 4 and use the identity 
(s + Po)is + ^0)""*^ = 1 for some pQ > to rewrite (6.4.22), (6.4.23) as 

e = Ace + Bc{s + po)p* (uf-e*^4>y e(0) = eo 
ei = Cje (6.4.24) 



I.e., 



where Be = BcCq, 



ei 



Wmis) (s + po) p* (uf - 9*^(P) (6.4.25) 



1 

Uf = n„, = uj 



s + Po s+po 

and Wmis),po > are chosen so that Wmis) (s + pq) is SPR. 

We use p, 9, the estimate of p*,0*, respectively, to generate the estimate 
ei of ei as 

ei = Wmis)is + po)piuf - e^<i)) 

If we follow the same procedure as in Section 6.4.2, then the next step is 
to choose Up so that ei = Wmis)is + Po)[0], ei = ei and (6.4.24) is in the 
form of the error equation (6.4.8) where the tracking error ei is related to 
the parameter error 6 through an SPR transfer function. The control law 
Up = 9'^ UJ (used in the case of n* = 1 ) motivated from the known parameter 
case cannot transform (6.4.23) into the error equation we are looking for. 



Instead if we choose Up so that 



Uf = e~<t> (6.4.26) 



we have ei = Wmis)is +Po)[0] and by substituting (6.4.26) in (6.4.24), we 
obtain the error equation 

e = Ace + Bcis + po)p*e'^(j), e(0) = cq 
ei = Cje (6.4.27) 
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or in the transfer function form 

ei = Wmis)(.s + po)p*e^(j) 

which can be transformed into the desired form by using the transformation 

e = e - B^p*¥(j) (6.4.28) 

i.e., 

g = A^e + Bip*e^4>, e(0) = cq 
ei = Cje (6.4.29) 

where Bi = A^Bc + B^po and Cj B^ = Cj BpC^ = due to n* = 2. With 
(6.4.29), we can proceed as in the case of n* = 1 and develop an adaptive 
law for 9. Let us first examine whether we can choose Up to satisfy equation 
(6.4.26). We have 

Up = (S + po) Uf = (s+ po) 0^(p 

which implies that 

Up = e'^uo + e'^cj) (6.4.30) 

Because 9 is made available by the adaptive law, the control law (6.4.30) 
can be implemented without the use of differentiators. Let us now go back 
to the error equation (6.4.29). Because 

Cj {sl - A,)-^ Bi = Cj (sI - Ac)-' Be (s + po) = W^is) (.s + po) 

is SPR, (6.4.29) is of the same form as (6.4.8) and the adaptive law for 
generating 9 is designed by considering 

where Pc = Pj > satisfies the MKY Lemma. As in the case of n* = 1, for 

9 = 9 = -Teicp sgn(p*) (6.4.31) 

the time derivative VofV along the solution of (6.4.29), (6.4.31) is given by 

V = e Lee < 

2 2 
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which impHes that e,9,ei £ £00 and e, ei e £2- Because ei = jjp — ym, we 
also have yp e £00 • The signal vector cf) is expressed as 



1 



s + Po 



{sI-F)-^gG-\s)yp 
{si - F)-^gyp 



(6.4.32) 



by using Up = G~^(s)yp. We can observe that each element of (j) is the 
output of a proper stable transfer function whose input is yp or r. Because 
yp,r E Coo we have (j) e £oo- Now e,0,(j) E Coo imply (from (6.4.28) ) that 
e and, therefore, Yc £ £00. Because uj,(j),ei G £00 we have 9 G £00 and 
Up e £00 and therefore all signals in the closed -loop plant are bounded. 
Prom (6.4.29) we also have that e £ £00, i-e., ei e £00, which, together with 
ei E Coo n £2, implies that ei(t) ^ as t ^ 00. 

We present the main equations of the overall MRAC scheme in Table 6.2 
and summarize its stability properties by the following theorem. 

Theorem 6.4.2 The MRAC scheme of Table 6.2 guarantees that 

(i) All signals in the closed-loop plant are hounded and the tracking error 
ei converges to zero asymptotically. 

(ii) // Rp, Zp are coprime and r is sufficiently rich of order 2n, then the 
parameter error \0\ = \6 — 9*\ and the tracking error e\ converge to 
zero exponentially fast. 

Proof (i) This part has been completed above. 

(ii) Consider the error equations (6.4.29), (6.4.31) which have the same form as 
equations (4.3.10), (4.3.35) with n^ = in Chapter 4. Using Corollary 4.3.1 we have 
that if 0, (/) e £00 and is PE, then the adaptive law (6.4.31) guarantees that \Q\ 
converges to zero exponentially fast. We have already established that yp, </) G £00- 
It follows from (6.4.32) and the fact that e\ and therefore y^ G £00 that G Lqo. 
Hence it remains to show that ^ is PE. 

As in the case of n* = 1 we write c^) as 
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Table 6.2 MRAC scheme: n* 



Plant 


yp — '^PRp(s)^P^ n — z, 


Reference 
model 


ym = Wra{s)r, Wm{s) = k^^ 


Control law 


ioi = Fuji + gUp, uJi{0) = 
UJ2 = Fuj2 + gyp, cu2(0) = 

•P = -po<P + ^, HO) = 

Up = e'^uj + 0'^(t) = 6^uj - (p'^Tcpei sgn{kp/km) 
uj=[uj,ujj,yp,r]'^, uJi^n^-\ 002 ^n^-^ 


Adaptive law 


9 = -reicf>sgn{kp/km), ei = yp - y^ 


Assumptions 


Zp{s) is Hurwitz; Wm{s){s+pQ) is strictly proper and 
SPR; F,g,T are as defined in Table 6.1; plant and 
reference model satisfy assumptions PI to P4, and 
Ml and M2, respectively 



where 



1 



s+po 



{sI-F)-^gG„'{s)Wrn{s) 
{si - Fy^gWmis) 

Wm{s) 

1 



and 



s + Po 



{sl - F)-hjG„\.s) 

{sI-Fr^g 

1 





ei 



Because ei G £2 l~l 'Cqo and ei ^ as i ^ c» it follows (see Corollary 3.3.1) that 
(^ G £2 n £00 and |^| ^ as t ^ (X). 
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Proceeding as in the proof of Theorem 6.4.1, we estabhsh that (j)m is PE and use 
Lemma 4.8.3 to show that (j) is also PE which imphes, using the results of Chapter 4, 
that 1^1 —> exponentially fast. Using (6.4.29) and the exponential convergence of 
1^1 to zero we obtain that ei converges to zero exponentially fast. □ 

Example 6.4.2 Let us consider the second order plant 



(s2 + ais + ao) 

where kp > 0, and ai, ao are constants. The reference model is chosen as 

5 





ym - 


(« + 


5f 


Using 


Table 6.2 the control law is 


designed as 




wi = 


-2uJi 


+ Up 




CO2 = 


-2UJ2 


+ yp 




^ = 


-4' + 


LO 




Up = 


e'^Lj- 


- (l>^T<f)ei 



where lu = {LJi,uj2,yp,r]^ ,ei = yp- ym,Po = 1, A(s) = s + 2 and j^f^ is SPR. 
The adaptive law is given by 

e= -Teicf) 

where F = F^ > is any positive definite matrix and 9 = [6'i, ^2, ^3, Cq]^ . 
For parameter convergence, the input Up is chosen as 

Up = Ai sin uJit + A2 sin uj2t 

for some Ai,A2 7^ and lui ^ UJ2- 

Figures 6.10 and 6.11 show some simulation results of the MR AC scheme for 
the plant with ai = 3, ao = —10, kp = 1. We start with an initial parameter vector 
^(0) = [3, 18, —8, 3]^ that leads to an initially destabilizing controller. The tracking 
error and estimated parameter error response is shown in Figure 6.10 for F = 
diag{2, 4, 0.8, 1}, and r = unit step. Due to the initial destabilizing controller, the 
transient response is poor. The adaptive mechanism alters the unstable behavior of 
the initial controller and eventually drives the tracking error to zero. In Figure 6.11 
we show the response of the same system when r = 3sin4.9t + 0.5cos0.7t is a 
sufficiently rich input of order 4. Because of the use of a sufficiently rich signal, 0(t) 
converges to ^* = [1, 12,-10,1]^. V 



6.4. DIRECT MRAC WITH UNNORMALIZED ADAPTIVE LAWS 361 





Figure 6.10 Response of the MRAC scheme for Example 6.4.2 with r(t) 
unit step function. 



Remark 6.4.4 The control law (6.4.30) is a modification of the certainty 
equivalence control law Up = 6'^u! and is motivated from stability con- 
siderations. The additional term 6'^ (p = —(p^Tcpei sgn(/)*) is a nonlin- 
ear one that disappears asymptotically with time, i.e., Up = O'^ uj + O^ (f) 
converges to the certainty equivalence control law as t ^ oo. The num- 
ber and complexity of the additional terms in the certainty equivalence 
control law increase with the relative degree n* as we demonstrate in 
the next section. 
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sec 




Figure 6.11 Response of the MRAC scheme for Example 6.4.2 with 
r{t) = 3 sin 4.9t + 0.5 sin 0.7i. 



Remark 6.4.5 The proof of Theorem 6.4.2 may be accomplished by using 
a minimal state space realization for the error equation 

The details of such an approach are left as an exercise for the reader. 



6.4.3 Relative Degree n* = 3 

As in the case of n* = 2, the transfer function Wmis) of the reference 
model cannot be chosen to be SPR because according to assumption (M2), 
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Wmis) should have the same relative degree as the plant transfer function. 
Therefore, the choice of Up = 6 to in the error equation 

ei = Wmis)p*iup - r^w) (6.4.33) 

will not lead to the desired error equation where the tracking error is related 
to the parameter error through an SPR transfer function. As in the case 
of n* = 2, let us rewrite (6.4.33) in a form that involves an SPR transfer 
function by using the techniques of Chapter 4, i.e., we express (6.4.33) as 

ei = Wm(s)(s + Po){s + pi)p* (uf - e*^(t>) (6.4.34) 

where 

^f = 7 77 7^P) <? = 7 77 7"^ 

and Wm{s),po,pi are chosen so that Wmis) = Wmis){s + Po){s + pi) is 
SPR, which is now possible because the relative degree of Wmis) is 1. For 
simplicity and without loss of generality let us choose 

Wmis) ^ 



is + Po)is + pi)is + qo) 
for some go > so that 

ei = -^^p*iuf - e*^<t>) (6.4.35) 

s + go ^ 

The estimate of ei of ei based on the estimates p, is given by 

ei = piuf - e'^cp) (6.4.36) 

If we proceed as in the case of n* = 2 we would attempt to choose 

Uf = e^<j) (6.4.37) 

to make ei = — — [0] and obtain the error equation 

ei = —^p*¥(t) (6.4.38) 

s + Qq 
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The adaptive law 

e = -Tei(f)sgn{p*) (6.4.39) 

will then follow by using the standard procedure. Equation (6.4.37), how- 
ever, implies the use of the control input 

Up = {s + po){s + pi)uf = {s + po){s + pi)e^(t> (6.4.40) 

which involves 9, that is not available for measurement. Consequently the 
control law (6.4.40) cannot be implemented and the choice of Uf = 0(f) is 
not feasible. 

The difficulty of not being able to extend the results for n* = 1 , 2 to n* > 
3 became the major obstacle in advancing research in adaptive control during 
the 1970s. By the end of the 1970s and early 1980s, however, this difficulty 
was circumvented and several successful MRAC schemes were proposed using 
different approaches. Efforts to extend the procedure of n* = 1,2 to n* > 3 
continued during the early 1990s and led to new designs for MRAC . One such 
design proposed by Morse [164] employs the same control law as in (6.4.40) 
but the adaptive law for 9 is modified in such a way that 9 becomes an 
available signal. This modification, achieved at the expense of a higher-order 
adaptive law, led to a MRAC scheme that guarantees signal boundedness 
and convergence of the tracking error to zero. 

Another successful MRAC design that has it roots in the paper of Feuer 
and Morse [54] is proposed in [162] for a third order plant with known high 
frequency gain. In this design, the adaptive law is kept unchanged but the 
control law is chosen as 

Up = 9^UJ + Ua 

where Ua is designed based on stability considerations. Below we present 
and analyze a very similar design as in [162]. 
We start by rewriting (6.4.35), (6.4.36) as 

ei = — p*{9'^(t) + ro), ei = — pro (6.4.41) 

s + qo s + qo 

where vq = Uf — 9'^ (p and 9 = 9 — 9*. 

Because vq cannot be forced to be equal to zero by setting Uf = 9'^ (p, we 
will focus on choosing Up so that ro goes to zero as t ^ oo. In this case. 
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the estimation error ei = ei — ei is not equal to ei because ei / owing to 
pro / 0. However, it satisfies the error equation 

ei = ei-ei = ^—ip*e^cl>-pro) (6.4.42) 

s + qo 

that leads to the adaptive law 

0=-Tei4>sgn{p*), p = jeivo (6.4.43) 

where T = r"*" and 7 > by considering the Lyapunov-like function 

y = — H \p \ + — 

2 2 "^ ' 27 

We now need to choose Ua in Up = 6 to + Ua to establish stability for the 
system (6.4.41) to (6.4.43). Let us now express ro as 

ro = Uf- 0'^4> = -^— \ui - F0 - 6'^cf>i 
s + po ^ 



where 



I.e., 



Ul = Up, (pl = {s + Po)(p = ■ U! 

s +pi s + pi 



ro = -poro + ui- 9^ 4) - 9'^ (pi (6.4.44) 

Substituting for 9, we obtain 

h = -Poro + ui + (f^Tcpei sgn(p*) - 9'^ (pi (6.4.45) 

If we now choose ui = —(p^T(peisgn{p*) + 9^ (pi then rg = ~Pofo ^-nd rg 
converges to zero exponentially fast. This choice of ui, however, leads to a 
control input Up that is not implementable since Up = (s +pi)ui will involve 
the first derivative of ui and, therefore, the derivative of ei that is not 
available for measurement. Therefore, the term (p'^r(pti sgn(p*) in (6.4.45) 
cannot be eliminated by ui. Its effect, however, may be counteracted by 
introducing what is called a "nonlinear damping" term in ui [99]. That is, 
we choose 

ui = 9'^(pi - ao ((p'^T(p) ro (6.4.46) 
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where ao > is a design constant, and obtain 



ro 



P0 + ao{ (p^Tcj) 



ro + (p T<t>eisgn{p*] 



The purpose of the nonhnear term {(p^Tcp)^ is to "damp out" the possible 
destabihzing effect of the nonhnear term (f^Tcpti as we show in the analysis 
to follow. Using (6.4.46), the control input Up = (s + pi)ui is given by 

Up = e'^uj + e'^^i - (s + pi)ao(0^r0) Vo (6.4.47) 

If we now perform the differentiation in (6.4.47) and substitute for the 
derivative of ro we obtain 



Up = e'^LO + F01 - 4.aQ(f^V(t) [<p^V^) ro - ao {pi - Po) {<P^Td^) ^ ro 

+al (fV<j))\o - ao (0^r0)%isgn(/>*) (6.4.48) 

where (p is generated from 



{s + Po){s + Pl) 



UJ 



which demonstrates that Up can be implemented without the use of differ- 
entiators. 

We summarize the main equations of the MRAC scheme in Table 6.3. 

The stability properties of the proposed MRAC scheme listed in Table 
6.3 are summarized as follows. 

Theorem 6.4.3 The MRAC scheme of Table 6.3 guarantees that 

(i) All signals in the closed-loop plant are hounded and ro(t), ei(t) ^ as 

t —I- oo. 

(ii) If kp is known, r is sufficiently rich of order 2n and Zp, Rp are coprime, 
then the parameter error \0\ = \6 — 9*\ and tracking error ei converge 
to zero exponentially fast. 

(iii) If r is sufficiently rich of order 2n and Zp,Rp are coprime, then \9\ and 
ei converge to zero asymptotically (not necessarily exponentially fast). 

(iv) The estimate p converges to a constant p asymptotically independent of 
the richness of r. 
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Table 6.3 MRAC scheme: n* = 3 



Plant 


yp — '^PRp(s)^p^ It — o 


Reference 
model 


Vm = Wm{s)r 


Control law 


uJi = Fuji + gUp, a;i(0) = 

UJ2 = Fuj2 + gyp, uj2{0) = 

ro = -(po + ao(0^r0)2)ro + (/>^r(/)eisgn(p*) 

Up = O'^U) + Ua 

n„ = r^i-ao(pi-po)(</'^r0)2ro-4ao</'^r0((/.Tr0)ro 
+a2(0Tr</,)4ro - ao(0^r(/))3eisgn(p*) 


Adaptive law 


= -rei(psgn(p*), p = 7eiro 
ei = ei ei, d = ,+y^pro 


(t)i - s+p,^^ ei -yp ym 


Design 
variables 


r = r^ > 0,7 > 0,ao > are arbitrary design con- 
stants; Wm{s){s + po){s + pi) is strictly proper and 
SPR; F,g are as in the case of n* = 1; Zp{s),Rp{s) 
and Wm{s) satisfy assumptions PI to P4, Ml and M2, 
respectively; sgn(p*) = sgn(kp/km) 



Proof (i) The equations that describe the stability properties of the closed-loop 
plant are 



h = -qo<^i + P*& (t>- pro 

ra = -{po + aa{(f)^T4>)^)ra + (t>'^T<l)ei sg-n{p*) 

= -Tei(f)sgTL{p*), p = jeiro 



(6.4.49) 
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We propose the Lyapunov-like function 

where 70 > is a constant to be selected. The time derivative of V along the 
trajectories of (6.4.49) is given by 

V = -qo4 - loPoro - ■yoaorl{(l>'^r<f)f + -/o€iro(t>^T<f) sgn(p*) 
< -qoef - 7oPo^o - loaorl{(l>^T(f)f + 7o|ei| \ro\4>'^T<f) 



By completing the squares we obtain 



V < -qoi 



2 



|eil 



7o- 



kol0^r</. 



<?0 



■7o- 



r'oi'P'm' 



< 



-Qo- 



loPoro 



aa 



7o 
2go 



2go 

7or2(<^^r,/-)2 



7oPo^o -7oao»'o(<^ Tc?!)) 



Because 70 > is arbitrary, used for analysis only, for any given ao and go > 0, we 
can choose it as 70 = 2aoqo leading to 

4 2 

V < -90 y -loPora < 

Hence, ei,rQ,p,9 e £00 and ei,rQ G £2- Because p, Tq G £00, it follows from 
(6.4.41) that ei G £00 which implies that ei = ei + ei G >Coo- Hence, yp G £00, 
which, together with 



{s + Po){s + Pi) 



{.sI-F)-^gG„\.s)yp 
{sI-F)-^gyp 



r 



(6.4.50) 



implies that (j) G Coo- Using ei,0 G £00 and ei G C2 in (6.4.49) we have 0,p €i 
'Coo n ^2- From the error equation (6.4.49) it follows that ei and, therefore, f/p G £00 
which imply that (p and cpi G Coo- The second derivative ei can be shown to be 
bounded by using 6,4>,rQ G £00 in (6.4.41). Because ei = jjp — s'^Wm{s)r and 
s'^Wjnis) is proper, it follows that jjp G £001 which, together with (6.4.50), implies 
that (f) G Coo- Because lu = {s +po)(s + Pi)'/'; we have that cj G Coo and therefore 
Wp and all signals are bounded. Because vq G Coof]C2 and p G £00, it follows 
from (6.4.41) that ei G Coof]C2, which, together with ei G Coof]C2, implies that 
ei G Coo f]C2- Because ei G Coo and ei G C2, it follows that ei(i) ^ as i ^ 00 
and the proof of (i) is complete. From ro E C2,ro E Coo we also have ro{t) ^ as 
t -^ 00. 
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(ii) First, we show that (p is PE if r is sufficiently rich of order 2n. Using the 
expression (6.4.50) for cp and substituting yp = Wmr + ei, we can write 



= 0m + 



where 



and 



1 


- [sI-F)-^gG-^W 
{sI-F)-^gWm 


{s + Po){s + Pi) 
1 


1 

" {sI-F)-hjG-^ - 

{sI-F)-^g 

1 




{s + po){s + pi) 



ei 



Using the same arguments as in the proof of Theorem 6.4.2, we can estabUsh that 
4>m is PE provided r is sufficiently rich of order 2n and Zp, Rp are coprime. Then 
the PE property of <j) follows immediately from Lemma 4.8.3 and ei G >C2- 
If kp is known, then p = and (6.4.49) is reduced to 



ei 



-Tei4>sgrL{p* 



(6.4.51) 



We can use the same steps as in the proof of Corollary 4.3.1 in Chapter 4 to show 
that the equilibrium tie = 0, ^e = of (6.4.51) is e.s. provided 4> is PE and 
(l),4> £ Coo- Since we have established in (i) that (t>,4' ^ >Coo, (ii) follows, 
(iii) When kp is unknown, we have 



ei = -qG<^i + P*0^(t>- pro 
9 = -rei0sgn(/9*) 



(6.4.52) 



We consider (6.4.52) as a linear-time- varying system with ei, as states and pro as 
the external input. As shown in (ii), when prg = and (f) is PE, the homogeneous 
part of (6.4.52) is e.s. We have shown in (i) that p G Coo, "Tq G Coo H C2 and ro(i) — > 
as i — > 00. Therefore, it follows (by extending the results of Corollary 3.3.1) that 
ei,^G Coor\^2 that ei{t),6{t) ^ as ^ ^ 00. 
(iv) Because ei^r^ G C2 we have 

t i-t 

\p\dT < J |ei||ro|dT 



< 7( / efdT)2{ rgdr) 2 < 00 
Jo Jo 
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which for t —> oo implies that p = p & Li and therefore p, p converge to a constant 
as t —> oo. □ 



Example 6.4.3 Let us consider the third order plant 

s-^ + 025^ + ais + flo 

where fcp,ao,ai,a2 are unknown constants, and the sign of kp is assumed to be 
known. The control objective is to choose Up to stabilize the plant and force the 
output Up to track the output Hm of the reference model given by 

_ 1 

Because n* = 3, the MRAC scheme in Table 6.3 is considered. We choose Pi = Po = 
2 so that Wm(s)(s+pi)(s +po) = jir^ is SPR. The signals uj,(f>,(j)i are generated as 



LUl 



UJ2 



' -10 


-25 


1 





■ -10 


-25 


1 






UJl 



U)2 ■ 



.T , ,T 



^2 ^Vp^ 



1 



-UJ, (/>: 



Up, tJi(O) 

Vp, tJ2(0) 

■V 
1 



s+2 s+2 

by choosing A(s) = (s + 5)^. Then, according to Table 6.3, the adaptive control law 
that achieves the control objective is given by 

Mp = 0^c^-eiSgn(fcp)<^^r,/.i-4ao'/'^r(^('^^r,^)ro + «2(^Tp^)4^^_^^(^Tp^)3^^gg^(^^) 

9 = -Vei4>sgrL{kp), p = jeiro 



1 



pra 



ei = ei-ei, ei = j/p - y™, ei = - 

S-r z, 

and ro is generated by the equation 

ro = -(2 + ao{ct>'^T^f)ro + <^^r,/.eiSgn(fcp) 

The simulation results of the MRAC scheme for a unit step reference input are 
shown in Figure 6.12. The plant used for simulations is an unstable one with transfer 
function Gp{s) = 3 g a^ s -in - "^^^ initial conditions for the controller parameters 
are: ^0 = [1.2,-9,31,160,-50,9]^, and p(0) = 0.2. The design parameters used 
for simulations are: T = 50/, 7 = 50, ao = 0.01. V 
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Figure 6.12 Response of the MRAC scheme for Example 6.4.3 with r(t)- 
unit step function. 



Remark 6.4.6 The effect of initial conditions can be taken into account by 
using 

ei = Wmis)p*iup - e*^uj) + Cl{sl - ^c)"'e(0) 

instead of (6.4.33). The proof can be easily modified to take care of 
the exponentially decaying to zero term that is due to e(0) / (see 
Problem 6.19). 

Similarly, the results presented here are valid only if the existence 
and uniqueness of solutions of (6.4.49) can be established. For further 
discussion and details on the existence and uniqueness of solutions of 
the class of differential equations that arise in adaptive systems, the 
reader is referred to [191]. 
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Remark 6.4.7 The procedure for n* = 3 may be extended to the case of 
n* > 3 by following similar steps. The complexity of the control input 
Up, however, increases considerably with n* to the point that it defeats 
any simplicity we may gain from analysis by using a single Lyapunov- 
like function to establish stability. In addition to complexity the highly 
nonlinear terms in the control law may lead to a "high bandwidth" 
control input that may have adverse effects on robustness with respect 
to modeling errors. We will address some of these robustness issues in 
Chapter 8. On the other hand, the idea of unnormalized adaptive laws 
together with the nonlinear modification of the certainty equivalence 
control laws were found to be helpful in solving the adaptive control 
problem for a class of nonlinear plants [98, 99, 105]. 



6.5 Direct MRAC with Normalized Adaptive 
Laws 

In this section we present and analyze a class of MRAC schemes that domi- 
nated the literature of adaptive control due to the simplicity of their design 
as well as their robustness properties in the presence of modeling errors. 
Their design is based on the certainty equivalence approach that combines a 
control law, motivated from the known parameter case, with an adaptive law 
generated using the techniques of Chapter 4. The adaptive law is driven by 
the normalized estimation error and is based on an appropriate parameteri- 
zation of the plant that involves the unknown desired controller parameters. 
While the design of normalized MRAC schemes follows directly from the 
results of Section 6.3 and Chapter 4, their analysis is more complicated than 
that of the unnormalized MRAC schemes presented in Section 6.4 for the 
case of n* = 1,2. However, their analysis, once understood, carries over to 
all relative degrees of the plant without additional complications. 

6.5.1 Example: Adaptive Regulation 

Let us consider the scalar plant 

X = ax + u, x(0) = xq (6.5.1) 



6.5. DIRECT MRAC WITH NORMALIZED ADAPTIVE LAWS 373 

where a is an unknown constant and —am is the desired closed-loop pole for 
some Cm > 0. 

The desired control law 

u = —k*x, k* = a + am 

that could be used to meet the control objective when a is known, is replaced 
with 

u=-k{t)x (6.5.2) 

where k(t) is to be updated by an appropriate adaptive law. In Section 
6.2.1 we updated k(t) using an unnormalized adaptive law driven by the 
estimation error, which was shown to be equal to the regulation error x. 
In this section, we use normalized adaptive laws to update k(t). These are 
adaptive laws driven by the normalized estimation error which is not directly 
related to the regulation error x. As a result, the stability analysis of the 
closed-loop adaptive system is more complicated. 

As shown in Section 6.2.1, by adding and subtracting the term —k*x in 
the plant equation (6.5.1) and using k* = a + am to eliminate the unknown 
a, we can obtain the parametric plant model 

X = —amX + k*x + u 

whose transfer function form is 

x= — ^ — {k*x + u) (6.5.3) 

S + Urn 

If we now put (6.5.3) into the form of the general parametric model 
z = W{s)6 x/j considered in Chapter 4, we can simply pick any adaptive 
law for estimating k* on-line from Tables 4.1 to 4.3 of Chapter 4. Therefore, 
let us rewrite (6.5.3) as 

z = k*x (6.5.4) 

s + am 

where z = x , u is available from measurement. 

Using Table 4.1 of Chapter 4, the SPR-Lyapunov design approach gives 
the adaptive law 

k = 7ex 
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1 



z eUg (6.5.5) 

S -j- dm 



S + an 



7 2 2 

kx, rig = X 



where 7 > is the adaptive gain and L(s) in Table 4.1 is taken as L(s) = 1. 
Rewriting (6.5.4) as z = k*4>, (p = s+a •'^^ ^^ ^^^ Table 4.2(A) to obtain 
the gradient algorithm 



k = 760 

z — z 



m? 



1 



s + a, 
and from Table 4.3(A), the least-squares algorithm 

k = pe(f>, p= K-, p(0) > 

,2 



m^ = 1 + (/)2 (6.5.6) 

X, z = kef), 7 > 



e = ^, z = kef), m = 1 + (p , (p = x (6.5.7) 

m^ s + am 

The control law (6.5.2) with any one of the three adaptive laws (6.5.5) 
to (6.5.7) forms an adaptive control scheme. 

We analyze the stability properties of each scheme when applied to the 

plant (6.5.1) as follows: We start by writing the closed-loop plant equation 

as 

X = — ^ — i-kx) (6.5.8) 

s -j- a^fi 

by substituting u = —kx in (6.5.3). As shown in Chapter 4 all three adaptive 

laws guarantee that k £ £00 independent of the boundedness of x, u, which 

implies from (6.5.8) that x cannot grow or decay faster than an exponential. 

However, the boundedness of k by itself does not imply that x £ £00, let 

alone x(t) ^ as t ^ cx). To analyze (6.5.8), we need to exploit the 

properties of kx by using the properties of the specific adaptive law that 

generates k{t). 

Let us start with the adaptive law (6.5.5). As shown in Chapter 4 using 

the Lyapunov-like function 

V=- + - 

2 27 
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and its time derivative 

V = -arr^t^ - e^nl < 

the adaptive law (6.5.5) guarantees that e, /c £ Coo and e,ens,k £ £2 in- 
dependent of the boundedness of x. The normahzed estimation error e is 
related to kx through the equation 

e = z — z eUg = { — kx — trig) (6.5.9) 

where n^ = x^. Using (6.5.9) and en^ = en^x in (6.5.8), we obtain 

X = e H eUg = e H eUgX (6.5.10) 

'-' 'T' Ojffi S -r dm 

Because e £ £00 H ^2 and tng G £2 the boundedness of x is established 
by taking absolute values on each side of (6.5.10) and applying the B-G 
lemma. We leave this approach as an exercise for the reader. 

A more elaborate but yet more systematic method that we will follow in 
the higher order case involves the use of the properties of the C25 norm and 
the B-G Lemma. We present such a method below and use it to understand 
the higher-order case to be considered in the sections to follow. 

Step 1. Express the plant output y (or state x) and plant input u in 
terms of the parameter error k. We have 

X = {—kx), u = {s — a)x = {—kx) (6.5.11) 

^ 'T' dffi S -r drn 

The above integral equations may be expressed in the form of algebraic 
inequalities by using the properties of the £25 norm ||(-)i||25, which for sim- 
plicity we denote by || • ||. 
We have 

||x|| < c||fcx||, ||n|| < c||fcx|| (6.5.12) 

where c > is a generic symbol used to denote any finite constant. Let us 
now define 

2^1 I II ||2 I II ||2 /c: n 1 o\ 

rrif = 1 + ||x|| + ||u|| (6.5.13) 

The significance of the signal ruf is that it bounds |x|, |x| and \u\ from above 
provided k G £00 • Therefore if we establish that rrif £ £00 then the bounded- 
ness of all signals follows. The boundedness of |x|/mj, |x|/my, \u\/mf follows 
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from k e £00 and the properties of the £25-iiorm given by Lemma 3.3.2, i.e., 
from (6.5.11) we have 



and 



Similarly, 



ruf 

\x{t)\ 



< 



1 



S + ttr, 



\k\^^—^ < c 
25 mf 



<a,.MI+wMM<e 



ruf nif 

\n{t)\ 



m 



f 



< 



< c 



nif rrif 

Because of the normalizing properties of vfif, we refer to it as the fictitious 
normalizing signal. 

It follows from (6.5.12), (6.5.13) that 



nif < 1 + c||A;x|| 



(6.5.14) 



Step 2. Use the Swapping Lemma and properties of the C25 norm to 
upper hound \\kx\\ with terms that are guaranteed by the adaptive law to have 
finite £2 gains. We use the Swapping Lemma A. 2 given in Appendix A to 
write the identity 



kx 



1 



ao 



s + ao 



kx H kx 

s + ao 



(kx + kx) H kx 



s + ao 



s + ao 



where ao > is an arbitrary constant. Since, from (6.5.11), kx = —{s+am)x, 
we have 



kx 



(kx + kx) — ao^ ^x 



s + ao 



(s + ao) 



(6.5.15) 



which imply that 
||A;x|| < 



1 



s + ao 



\kx\\ + ||A;x||) + ao 



00 (5 



s + ar, 



s + ao 



00 (5 



For ao > 2am > S, we have 11— — ||oo5 = n 1 < — , therefore. 



_2_ 



\kx\\ < — (||A:x|| + ||A:i;||) + aoc||x| 
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where c = ||^4^^||oo<5- Since ^, ^ G £00, it follows that 

~ C ~ 

\\kx\\ < — (||A;mj|| + ||A:mj||) + aoc||x|| (6.5.16) 

Equation (6.5.16) is independent of the adaptive law used to update k{t). 
The term — ||fcm/|| in (6.5.16) is "small" because A; e £2 (guaranteed by any 
one of the adaptive laws (6.5.5) - (6.5.7)), whereas the term — ||fcmj|| can 
be made small by choosing oq large but finite. Large oq, however, may 
make aoc||a;|| large unless ||x|| is also small in some sense. We establish 
the smallness of the regulation error x by exploiting its relationship with 
the normalized estimation error e. This relationship depends on the specific 
adaptive law used. For example, for the adaptive law (6.5.5) that is based 
on the SPR-Lyapunov design approach, we have established that 

1 2 

X = e H trig 

s + ajn 
which together with |en^| < \tns\—mf < cengnif imply that 

\\x\\ < ||e|| + c||ensm/|| 

hence, 

~ c ~ ~ 

||A;x|| < — (||A;mj|| + ||A:mj||) + aoc||e|| + aoc||ensmj|| (6.5.17) 

Similarly, for the gradient or least-squares algorithms, we have 

X = em H k(p (6.5.18) 



obtained by using the equation 

kx = k(j) k(j) 

that follows from Swapping Lemma A.l together with the equation for em? 
in (6.5.6). Equation (6.5.18) implies that 

\\x\\ < ||e|| + llen^ll + c 
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Because n^ = (p'^ and 4> = jqi^^;, we have \4>{t)\ < c\\x\\ which iniphes that 
-^ e £00 and, therefore, 

rrif 

\\x\\ < ||e|| + Ijensmjll + c||A;m,j|| 

Substituting for ||2;|| in (6.5.16), we obtain the same expression for ||A:x|| as 
in (6.5.17). 

Step 3. Use the B-G Lemma to establish houndedness. From (6.5.14) 
and (6.5.17), we obtain 

m,j<l + aocH 2(ll^"^/ll + ll^^^/ll ) + caolk"-*"^/!! (6.5.19) 

by using the fact that e G £00 0-^2- We can express (6.5.19) as 

my < 1 + OqC H 2 11™"/!! + '^'^oll5"^/ll (6.5.20) 

where cf^ = |ensp + Mr- Because the adaptive laws guarantee that tng, k £ 
£2 it follows that 5 £ £2- Using the definition of the £25 norm, inequality 
(6.5.20) may be rewritten as 

m}<l + cal + c f e-^(*-^) (alfir) + ^) mj{T)dT 

Jo \ ttg / 

Applying the B-G Lemma III, we obtain 

ft 
m'j<(l + ca^)e-^(*-^)$(t, to) + (1 + cal)5 / e-^'^^-^'>^{t, T)dT 



where 

g>(t,T) = e e J-r oy y ) 



Choosing oq so that -% < o' Q^o > 2om and using ^ e £2, it follows that 
nif e £00. Because m,j bounds x,x,u from above, it follows that all signals 
in the closed-loop adaptive system are bounded. 

Step 4. Establish convergence of the regulation error to zero. For the 
adaptive law (6.5.5), it follows from (6.5.9), (6.5.10) that x £ £2 and from 
(6.5.8) that X G £oo- Hence, using Lemma 3.2.5, we have x{t) ^ as t ^ 00. 
For the adaptive law (6.5.6) or (6.5.7) we have from (6.5.18) that a; G £2 
and from (6.5.8) that x e £00, hence, x{t) ^ as t ^ 00. 
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6.5.2 Example: Adaptive Tracking 

Let us consider the tracking problem defined in Section 6.2.2 for tlie first 
order plant 

X = ax + bu (6.5.21) 

where a, b are unknown (with 6/0). The control law 

u=-k*x + l*r (6.5.22) 

where 

r = ^^^, r = ^ (6.5.23) 

guarantees that all signals in the closed-loop plant are bounded and the plant 
state X converges exponentially to the state Xm of the reference model 

^™ -r (6.5.24) 



III, 

s + am 
Because a, b are unknown, we replace (6.5.22) with 

u= -k{t)x + lit)r (6.5.25) 

where k{t),l{t) are the on-line estimates of k*,l*, respectively. We design 
the adaptive laws for updating k{t), l{t) by first developing appropriate 
parametric models for k*,l* of the form studied in Chapter 4. We then 
choose the adaptive laws from Tables 4.1 to 4.5 of Chapter 4 based on the 
parametric model satisfied by k*,l*. 

As in Section 6.2.2, if we add and subtract the desired input —bk*x + bl*r 
in the plant equation (6.5.21) and use (6.5.23) to eliminate the unknown a, 
we obtain 

X = —amX + brnV + h{u + k*x — l*r) 

which together with (6.5.24) and the definition of ei = x — Xm give 

ei = {u + k*x-l*r) (6.5.26) 

S -r a'fri 

Equation (6.5.26) can also be rewritten as 

ei = 6(r^0 + u/) (6.5.27) 
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where 6* = [k*,l*],(j) = ^.^ [x, —r] ,Uf = ^ u. Both equations are in 
the form of the parametric models given in Table 4.4 of Chapter 4. We can 
use them to choose any adaptive law from Table 4.4. As an example, let us 
choose the gradient algorithm listed in Table 4.4(D) that does not require 
the knowledge of sign b. We have 



k = N(w)jie(pi 

I = N{w)-f2t(t)2 

I = N{w)je^ 

N{w) = w'^cosw, W = Wq + 



b^ 



27 

Wq = em, wo{0) = 
ei - ei 



m 



2 



ei = N{w)b^ (6.5.28) 



4 = k(f)l+l(t)2 + Uf, Uf = u 

S + ttm 

91 = —- X, (p2 = r 

m = l + rig, Ug = (j)i + (f)2 + Uj 
71,72,7 > 

As shown in Chapter 4, the above adaptive law guarantees that k, I, w, 
Wq £ >Coo and e,ens,k,l,b £ -Coo 0-^2 independent of the boundedness of 
u,ei,(f). 

Despite the complexity of the adaptive law (6.5.28), the stability anal- 
ysis of the closed-loop adaptive system described by the equations (6.5.21), 
(6.5.25), (6.5.28) is not more complicated than that of any other adaptive 
law from Table 4.4. We carry out the stability proof by using the properties 
of the £2<5-iiorm and B-G Lemma in a similar way as in Section 6.5.1. 

Step 1. Express the plant output x and input u in terms of the parameter 
errors k,L From (6.5.24), (6.5.25) and (6.5.26) we have 



s + ttr, 



kx — Ir) = (bmr + blr — bkx) (6.5.29) 

/ s -I- a^ V / 
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and from (6.5.21), (6.5.29) 

(s — a) (s — a) 



b{s + Qr. 



\^bmr + blr - fcfcx] (6.5.30) 



For simplicity, let us denote ||(-)t||2(5 by || • ||. Again for the sake of clarity 
and ease of exposition, let us also denote any positive finite constant whose 
actual value does not affect stability with the same symbol c. Using the 
properties of the £25-iiorm in (6.5.29), (6.5.30) and the fact that r,l G £oo 
we have 

||x|| < c + c||A;x||, ||u|| < c + c||A;x|| 

for any 5 £ [0,2am), which imply that the fictitious normalizing signal de- 
fined as 

oA II ||2 II ||2 

mj = 1 + ||x|| + ||u|| 



satisfies 



m}<c + c\\~kxf (6.5.31) 



We verify, using the boundedness of r, I, k, that (pi/rrif, x/mfjUs/nif £ Coo 
as follows: From the definition of (pi, we have |i;/>i(t)| < c||x|| < cmf. Simi- 
larly, from (6.5.29) and the boundedness of r, I, k, we have 

\x(t)\ < c+ c\\x\\ < c+ crrif 



Because x = —UmX + b^r + blr — bkx, it follows that |a;| < c + crrif. Next, 
let us consider the signal n^ = 1 + 0f + (/)2 + ul. Because \uf\ < c\\u\\ < cnif 
and — , 4>2 G -Coo 5 it follows that n^ < cmj . 

Step 2. Use the Swapping Lemma and properties of the C25 norm to 
upper bound \\kx\\ with terms that are guaranteed by the adaptive law to have 
finite C2-gains. We start with the identity 

kx = (1 I kx -\ kx = [ kx + kx) -\ kx 

\ s + aoJ s + ao s + ctoV / s + oq 

(6.5.32) 

where ao > is an arbitrary constant. From (6.5.29) we also have that 

kx = , "* ei + Ir 
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where ei = x — Xm, which we substitute in the second term of the right-hand 
side of (6.5.32) to obtain 

kx = ikx + kx] — ^ei H Ir 

s + ao \ J b [s + ao) s + ao 

Because k,l,r e Coo we have 

c ~ c 

\\kx\\ < — \\kx\\ H ||i|| + a;oc||ei|| + c (6.5.33) 

ao "0 

for any < 5 < 2am < oq. 

As in Section 6.5.1, the gain of the first two terms on the right-hand side 
of (6.5.33) can be reduced by choosing ao large. So the only term that needs 
further examination is aoc||ei||. The tracking error ei, however, is related 
to the normalized estimation error e through the equation 

ei = em^ + N{w)b^ = e + en^ + N{w)b(, 

that follows from (6.5.28). 

Because e, en^ £ £oo r\^2 and N(w)b e Coo, the signal we need to con- 
centrate on is ^ which is given by 

^ = k(f)i + l(j)2 H u 

S -r Q>rn 
We consider the equation 
1 



-u 



1 1 

{ — kx + Ir) = —kcl)i — l(p2 H {k4>i + Ir) 

-am s + am ^ ' 



s^ am s + 

obtained by using the Swapping Lemma A.l or the equation 

(s + am){k4>\ + l(\)2) = kx - Ir + {kcpi + l(f)2) = u+ k(f)i + l(j)2 

Using any one of the above equations to substitute for ki(j)i + /02 in the 
equation for ^ we obtain 

C=^^{k<Pi + i<t>2) 

s -f- am. 



hence 



ei = e + en^ + 7V(ty)6 (kcpi + /(/>2) (6.5.34) 

s + am 
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Because e,N(w),b,l,(f)2,r £ £00 it follows from (6.5.34) that 

lldll < c+ llen^ll +c\\k4>i\\ (6.5.35) 

and, therefore, (6.5.33) and (6.5.35) imply that 

\\kx\\ < c + cttQ H ||^a;|| H ||x|| + aocJIen^H + aoc||A;(;^i|| (6.5.36) 

Step 3. Use the B-G Lemma to establish boundedness. Using (6.5.36) 
and the normalizing properties of rrif, we can write (6.5.31) in the form 

2 ^ I 2, ''II; ||2i '^11 ||2i 2|| ||2i 2||;' ||2 

rrif < c+caQ^ ^"IF^/II H 2ll"''/ll + '^o'^ll^^-s^'/ll + ctQcWknifW 

o 0|| ||0 ^iiii9 / 

< c + cckq + cap ll^mj II H 2ll"''/ll (6.5.37) 



A 



where g'^ = ^|A;p + |e^^s| + \k\. Inequality (6.5.37) has exactly the same 
form and properties as inequality (6.5.20) in Section 6.5.1. Therefore the 
boundedness of nif follows by applying the B-G Lemma and choosing ckq > 
max{4a^, ^} as in the example of Section 6.5.1. 

From ruf £ £00 we have x,x,ns,4'i £ £00, which imply that u and all 
signals in the closed- loop plant are bounded. 

Step 4. Establish convergence of the tracking error to zero. We show the 
convergence of the tracking error to zero by using (6.5.34). From e, eug, k, I G 
C2 and Us, N(w)b, (j)i,4>2 £ ^00 we can establish, using (6.5.34), that ei £ £2 
which together with ei = x — Xm £ £00 imply (see Lemma 3.2.5) that 
ei(t) ^ as t ^ cx). 

6.5.3 MRAC for SISO Plants 

In this section we extend the design approach and analysis used in the ex- 
amples of Sections 6.5.1 and 6.5.2 to the general SISO plant (6.3.1). We con- 
sider the same control objective as in Section 6.3.1 where the plant (6.3.1) 
and reference model (6.3.4) satisfy assumptions PI to P4, and Ml and M2, 
respectively. 

The design of MRAC schemes for the plant (6.3.1) with unknown pa- 
rameters is based on the certainty equivalence approach and is conceptually 
simple. With this approach, we develop a wide class of MRAC schemes by 
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combining the MRC law (6.3.22), where 6* is replaced by its estimate 6(t), 
with different adaptive laws for generating 0(t) on-line. We design the adap- 
tive laws by first developing appropriate parametric models for 9* which we 
then use to pick up the adaptive law of our choice from Tables 4.1 to 4.5 in 
Chapter 4. 

Let us start with the control law 

whose state-space realization is given by 

LOi = Fuji + gUp, uji(0) = 

6j2 = Fuj2 + 9yp, uj2{0) = (6.5.39) 

Up = 6 ll) 

where 6 = [Oj, 62 ,6s, cq]^ and uj = [ujj ,uj2 ,yp, r]'^ , and search for an adap- 
tive law to generate 9(t), the estimate of the desired parameter vector 9* . 
In Section 6.4.1 we develop the bilinear parametric model 

ei = WUs)p*[up-9*^Lj] (6.5.40) 

where p* = -^,9* = [91^, ^2^, ^3, Cq]^ by adding and subtracting the desired 
control input 6*'^uj in the overall representation of the plant and controller 
states (see (6.4.6)). The same parametric model may be developed by using 
the matching equation (6.3.13) to substitute for the unknown plant polyno- 
mial Rp{s) in the plant equation and by cancelling the Hurwitz polynomial 
Zp{s). The parametric model (6.5.40) holds for any relative degree of the 
plant transfer function. 

A linear parametric model for 9* may be developed from (6.5.40) as 
follows: Because p* = ^ and 9*^uj = 9*o^uJo + c^r where 9*^ = [9f,9f,9l,]'^ 
and loq = [ujj , loJ , yp]^ , we rewrite (6.5.40) as 



Wrn{s)Up = CgCi + Wm{s)9Q'^ UJq + clWrn{s)r 

Substituting for ei = yp — ym and using ym = Wmis)r we obtain 

Wmis)Up = clVp + Wm{s)9l^ ijjQ 
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which may be written as 



Q*T , 



(6.5.41) 



where 



Z = Wm{s)Up 

(pp = [Wmis)ujJ,Wmis)ujJ,Wm(.s)yp,yp]^ 

In view of (6.5.40), (6.5.41) we can now develop a wide class of MRAC 
schemes by using Tables 4.1 to 4.5 to choose an adaptive law for 9 based on 
the bilinear parametric model (6.5.40) or the linear one (6.5.41). 

Before we do that, let us compare the two parametric models (6.5.40), 
(6.5.41). The adaptive laws based on (6.5.40) listed in Table 4.4 of Chap- 
ter 4 generate estimates for Cq as well as for p* = —. In addition, some 
algorithms require the knowledge of the sgn(p*) and of a lower bound for 
\p*\. On the other hand the adaptive laws based on the linear model (6.5.41) 
generate estimates of Cg only, without any knowledge of the sgn(p*) or lower 
bound for |p*|. This suggests that (6.5.41) is a more appropriate parameter- 
ization of the plant than (6.5.40). It turns out, however, that in the stability 
analysis of the MRAC schemes whose adaptive laws are based on (6.5.41), 
l/co(t) is required to be bounded. This can be guaranteed by modifying 
the adaptive laws for co(t) using projection so that |co(t)| > Cg > 0,Vt > 
for some constant Cq < \cq\ = |-^|. Such a projection algorithm requires 

Krr 



the knowledge of the sgn(cg) = sgn ( -^j and the lower bound Cq, which is 
calculated from the knowledge of an upper bound for \kp\. Consequently, as 
far as a priori knowledge is concerned, (6.5.41) does not provide any spe- 
cial advantages over (6.5.40). In the following we modify all the adaptive 
laws that are based on (6.5.41) using the gradient projection method so that 
\co{t)\ > Co >0 Vt > 0. 

The main equations of several MRAC schemes formed by combining 
(6.5.39) with an adaptive law from Tables 4.1 to 4.5 based on (6.5.40) or 
(6.5.41) are listed in Tables 6.4 to 6.7. 

The basic block diagram of the MRAC schemes described in Table 6.4 is 
shown in Figure 6.13. An equivalent representation that is useful for analysis 
is shown in Figure 6.14. 
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Table 6.4 MRAC schemes 



Plant 


J Zp[s) 

yp '^PHp(s)'^p 


Reference model 


ym = fcml^r = Wm{s)r 


Control law 


uJi = Fuji + QUp, ^i{0) = 

UJ2 = FuJ2 + gVp, CJ2(0) = 

Up = 9^ uj 
uJi^K''-^, i = l,2 


Adaptive law 


Any adaptive law from Tables 6.5, 6.6 


Assumptions 


Plant and reference model satisfy assumptions PI 
to P4 and Ml, M2 respectively. 


Design variables 


F,g chosen so that (si — F)~^g = ^i4, where 
a{s) = [s"-2, s"-3, . . . , s, 1]T for n > 2 and a{s) = 
forn = 1; A(s) = s""^ + A„_2s"-2 + . . . + Aq is 
Hurwitz. 



Figure 6.14 is obtained by rewriting Up as 



r^cj + e'^uj 



where 6 = 9 — 9*, and by using the results of Section 6.4.1, in particular, 
equation (6.4.6) to absorb the term 9*^lu. 

For 9 = 9 — 9* = 0, the closed-loop MRAC scheme shown in Figure 6.14 
reverts to the one in the known parameter case shown in Figure 6.5. For 
9^0, the stability of the closed-loop MRAC scheme depends very much on 
the properties of the input —9uj, which, in turn, depend on the properties 

of the adaptive law that generates the trajectory 9{t) = 9{t) — 9*. 
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Table 6.5 Adaptive laws based on ei = Wmis) p* (u^ 



]*T, 



A. Based on the SPR-Lyapunov approach 


Parametric 
model 


ei = W^,{.s)L{s)[p*{uf-e*^<P)] 


Adaptive law 


9 = -Tecp sgn{kp/km) 

p = 7e^, e= ei- ei-Wm{s)L{s){enl) 

ei = Wm{s)L{sMuf-e'^(t))] 

^ = Uf-e'^(l), (p = L-^{s)Lj 

Uf = L~^(s)up, n1 = (f^ 4> + ""/ 


Assumptions 


Sign {kp) is known 


Design 
variables 


r = r^ > 0,7 > 0; Wyn{s)L{s) is proper and SPR; 
L~'^{.s) is proper and has stable poles 


B. Gradient algorithm with known sgn(A;p) 


Parametric 
model 


ei = p*{uf-e*'^<P) 


Adaptive law 


6 = -Pe^ sgn(kp/km) 
p = -1ti 

ei = p{uf -0^ (p) 

<P = Wm(s)uJ, Uf = Wmis)Up 

C = uf- e'^cp 

m^ = 1 + (p'^cj) + u^ 


Design 
variables 


r = rT >o,7>o 
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Table 6.5 (Continued) 



C. Gradient algorithm with unknown sgn(fcp) 


Parametric 
model 


ei = p*{uf-e*'^<P) 


Adaptive law 


e = -N(xo)Te(P 

p = N{xo)je^ 

N(xo) = Xgcosxo 

xo = wo + ^, Wo = t^m?, wo(0) = 

e=^,ei = iV(xo)p(n/-^T</)) 

(f) = Wm{s)uJ, Uf = Wm{s)Up 

C = u/ - e'^cp, m^ = 1 + n^, n^ = (f^ (f) + uj 


Design 
variables 


r = r^ > 0, 7 > 



The following theorem gives the stability properties of the MRAC scheme 
shown in Figures 6.13 and 14 when the adaptive laws in Tables 6.5 and 6.6 
are used to update 9(t) on-line. 

Theorem 6.5.1 The closed-loop MRAC scheme shown in Figure 6.13 and 
described in Table 6.4 with any adaptive law from Tables 6.5 and 6.6 has the 
following properties: 

(i) All signals are uniformly bounded. 

(ii) The tracking error ei = yp — i/m converges to zero as t ^ 00. 

(iii) // the reference input signal r is sufficiently rich of order 2n, r £ £00 
and Rp, Zp are coprime, the tracking error ei and parameter error 
6 = — 6* converge to zero for the adaptive law with known sgn{kp) . 
The convergence is asymptotic in the case of the adaptive law of Table 
6. 5 (A, B) and exponential in the case of the adaptive law of Table 6.6. 
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Table 6.6 Adaptive laws based on Wmis)up = 6 



*T, 



Constraint 



g{d) = Co - Co sgncQ < 

^ = [^1 )^2 )^3,Co] 



Projection 
operator 



(T, 



PriTx] 



if 



L'x It |co(t)| > Cq or 

if |co(t)| =Co and {Tx^Vg < 
Tx-T^S^^Tx otherwise 

ic»Ti+ A 1 frf^T»Tf Vivn 



A. Gradient Algorithm 



Adaptive law 



Pr[rt 



Design variable 



r^ >0 



B. Integral gradient a Algorithm 



Adaptive law 



e = Pr[-T{Re + Q)] 

R=-/3R+tl^^ i?(0)=0 

Q = -(3Q-§z, Q{0) = 

Z = Wmis)Up 



Design 
variable 



r = r^ > 0,/3> 



C. Least-squares with covariance resetting 



Adaptive law 



P=< 



Pr[Pec^p] 

-P<Pp<pJP 



Pitt) 



Pn 



if |co(t)| > Co or 
if |co(t)| = Co and (Pecppy V 5 < 
otherwise 
= Pol 



Design 
variable 



P(0) 



P (0) > 0, tr is the time for which 



Amm(P(t)) < pi,pi > po>0 



Common signals and variables 



e= '^-^:^T^-\ z = e'^^p,m^ 



:l + ( 



p'rp 



(pp = [Wm{s)uJ{ , Wm{s)uJ^ , Wm{s)yp, Vp] 

|co(0)| > Co,0 < Co < |co|, sgn(co(0)) = sgn(kp/k„ 
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Table 6.7 Hybrid MRAC 



Parametric 
model 


W^{s)up = r^^p 


Control law 


cJi = Fuji + gUp 
UJ2 = Fu2 + gy.p 
up(t) = 0juj(t), te(tk,tk+i] 


Hybrid 
adaptive law 


ek+i=Pr{ek+rjl'+XT)Mr)dT} -, k=o, 1,2,... 
e='^-^p-\ z{t) = ej<l>p, te(4,t,+i] 

m2 = 1 + pcpJcPp 
where Pr[-] is the discrete-time projection 

Prix)-/'' if|^o|>Co 
[^ + ^i^o - ^o)sgn{co) otherwise 

where xq is the last element of the vector x; 70 is 

the last column of the matrix T, and 700 is the last 

element of 70 


Design 

variables 


I3>l;tk = kTs, T, > 0; r = r^ > 
2 - TsXmaxiT) > 7 for some 7 > 



Outline of Proof The proof follows the same procedure as that for the ex- 
amples presented in Sections 6.5.1, 6.5.2. It is completed in five steps. 

Step 1. Express the plant input and output in terms of the adaptation error 
6^ uj. Using Figure 6.14 we can verify that the transfer function between the input 
r + 



Lo and the plant output yp is given by 
Vp = Gc{s 



1 ;.-, 



where 



Gc(s) 



CQKpZ/p 



(1 _ 0*T(^j _ F)-^g)Rp - kpZp[e*^^{sI - F)-^g + 0*] 



Because of the matching equations (6.3.12) and (6.3.13), and the fact that [si 



F)-'9 



A(s)' 



we have, after cancellation of all the stable common zeros and poles 
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Wm{s) 




r-\ r\ 



Gp{s) 




ei 



Vp 



[sI-F)-^g 



n 



i.sI-F)-^g 



tui 



ej 



LU2 



+ 



Adaptive Law 

from 

Tables 6.5 to 6.7 



Vpi Vmi Up 



Figure 6.13 Block diagram of direct MRAC with normalized adaptive 
law. 

in Gc{s), that Gc{s) = Wm{s). Therefore, the plant output may be written as 

^ "' ' (6.5.42) 



Vp = Wm{s)\r+-e' 

Because yp = Gp{s)up and Gp^{s) has stable poles, we have 

Up = G;\s)W„,{s) (r + ^e^^) 

where GZ^^{s)Wm{s) is biproper Because of Assumption M2. 
We now define the fictitious normalizing signal nif as 

mj^l + Wupr+Wypf 



(6.5.43) 



(6.5.44) 



where || • || denotes the >C2(S-norm for some S > 0. Using the properties of the C25 
norm it follows that 

mf <c+c\\Fuj\\ (6.5.45) 
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1 aT 




Figure 6.14 Equivalent representation of the MRAC scheme of Table 6.4. 

where c is used to denote any finite constant and (5 > is such that Wm{s — 
|),G'~^(s — |) have stable poles. Furthermore, for 9 G Coo (guaranteed by the 
adaptive law) , the signal nif bounds most of the signals and their derivatives from 
above. 

Step 2. Use the Swapping Lemmas and properties of the C25 norm to upper 
bound ||^^(jj|| with terms that are guaranteed by the adaptive law to have finite 
C2 gains. This is the most complicated step and it involves the use of Swapping 
Lemmas A.l and A. 2 to obtain the inequality 



uj\\ < —rrif + cao \\gmf\ 
ao 



(6.5.46) 



where g^ = e'^ri^ + \9\'^ + e^ and g is guaranteed by the adaptive law to belong to 
C2 and Qfo > is an arbitrary constant to be chosen. 

Step 3. Use the B-G Lemma to establish boundedness. From (6.5.45) and 
(6.5.46), it follows that 



nif < c + 



T"f 



'U^fW 



(6.5.47) 



^l 



f<c+c a'o" g^{T)mj{T)dT 
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for any ao > ag and some a^ > 0. 

Applying the B-G Lemma and using g £ C2, the boundedness of nif follows. 
Using TO/ G £00, we establish the boundedness of all the signals in the closed- loop 
plant. 

Step 4. Show that the tracking error converge to zero. The convergence of ei 
to zero is established by showing that ei G C2 and ei G Ceo and using Lemma 3.2.5. 

Step 5. Establish that the parameter error converges to zero. The convergence 
of the estimated parameters to their true values is established by first showing that 
the signal vector 4> or (pp, which drives the adaptive law under consideration, can 
be expressed as 

(j) or (f>p = H{s)r + (j) 

where H{s) is a stable transfer matrix and (j) £ C2. If r is sufficiently rich of 
order 2n and Zp, Rp are coprime then it follows from the results of Section 6.4 that 
(f>m = H[s)r is PE, which implies that 4> or (})p is PE. The PE property of 4>p or (j) 
guarantees that 6 and ei converge to zero as shown in Chapter 4. 

A detailed proof of Theorem 6.5.1 is given in Section 6.8. □ 

The MRAC scheme of Table 6.4 with any adaptive law from Table 6.5 
guarantees that ^ ^ C2 which together with e G £2 implies that p e £1, i.e., 



2^1 A c2 



2 



p\dT <'yi e^dTJ ( / C^drj < 00 

which, in turn, implies that p(t) converges to a constant as t ^ 00 indepen- 
dent of the richness of r. 

The stability properties of the hybrid MRAC scheme of Table 6.7 are 
similar to the continuous-time MRAC schemes and are summarized by the 
following Theorem. 

Theorem 6.5.2 The closed-loop system obtained by applying the hybrid 
MRAC scheme of Table 6.7 to the plant given in Table 6.4 has the following 
properties: 

(i) All signals are bounded. 

(ii) The tracking error ei converges to zero as t ^ 00. 

(iii) If r is sufficiently rich of order 2n and Zp,Rp are coprime, then the 

parameter error Oj. = 6]. — 9* converges exponentially fast to zero as k, 

t —> 00. 
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Proof First, we show that the projection algorithm used in Table 6.7 guarantees 
\cok\ > Cg Vfc > without affecting (i) to (iii) of the hybrid adaptive law established 
in Theorem 4.6.1. We rewrite the adaptive law of Table 6.7 as 






(6.5.48) 



Ap 



A 



if |c^(fc+i)l>Co 

:^(co-c(J(fe+i))sgn(co) otherwise 



where d, 



0(fc+l) 



the last element of the vector ^^ , j^. We can view 0^,^, d^^i as 
the pre- and post-projection estimate of 6* respectively. It is obvious, from the 
definition of 70,700 that Co(k+i) = CoSgn(co) if Icgj^.^^)! < Cq and Co(k+i) = c^(fe+i) 
if |cq/;j I ]^)| > Cf). Therefore, the constraint cofe > Cq is satisfied for all k. 

Now consider the same Lyapunov function used in proving Theorem 4.6.1, i.e.. 



V{k) 



~^lT-'0, 



we have 

V{k + 1) = ell,T-'el^, + 2ell,T-'Ap + {Ap)'^T-'Ap (6.5.49) 

In the proof of Theorem 4.6.1, we have shown that the first term in (6.5.49) satisfies 



oil^r-'oi^, < V{k) - (2 - TsK 



e'^{T)m'^{T)dT 



(6.5.50) 



For simplicity, let us consider the case sgn(co) = 1. Exactly the same analysis can 
be carried out when sgn(co) = —1. Using F^^F = / and the definition of 7o,7oOi 
we have 

" 



r-So 



Therefore, for c?cj, , j^-, < Cq, the last two terms in (6.5.49) can be expressed as 

2ell^T-^Ap+{Ap)'^T-^Ap 



1 

700 



(Cq CQ)(cg -I- Cpj.^,_|_j^j 2cq) < 
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where the last inequaUty follows because Cg > Cg > c^(f^,i\- For Cg/^, , ^s > Cg, we 
have 29ll^T-^Ap+ (Ap)^r-iAp = 0. Hence, 

2elljT-'^Ap + {Ap)'^T-^Ap < 0, Vfc > (6.5.51) 

Combining (6.5.49)-(6.5.51), we have 



AV{k) = V{k+l)-V{k) <-{2-Ts\m) I ^ e^{T)m^{T)dT 

which is similar to (4.6.9) established for the hybrid adaptive law without projection. 
Therefore, the projection does not affect the ideal asymptotic properties of the 
hybrid adaptive law. 

The rest of the stability proof is similar to that of Theorem 6.5.1 and is briefly 
outlined as follows: Noting that 9{t) = Ok,'^t G [fcT,, (fc + l)Ts) is a piecewise con- 
stant function with discontinuities at i = fcTg, fc = 0, 1, . . . , and not differentiable, 
we make the following change in the proof to accommodate the discontinuity in 
dk- We write d{t) = 9{t) + {9{t) — 9{tj) where d{t) is obtained by linearly inter- 
polating 6k,6k+\ on the interval \kTs,{k + 1)21,). Because 6k G Coo,A9k G C2, 
we can show that 9 has the following properties: (i) 9 is continuous, (ii) 9{t) = 
Ou+i - 9k^t e [fcr„(fc+ 1)T,), and 9 e Coor\J^2, (in) \0{t) - 9{t)\ < \9k+i - 9k\ 
and \9(t) — 9{t)\ e Coof]^2- Therefore, we can use 9 in the place of 9 and the 
error resulting from this substitution is [9 — 6)'^oj, which has an C2 gain because 
|0 — f?| G £2- The rest of the proof is then the same as that for the continuous 
scheme except that an additional term {6 — 9)'^llj appears in the equations. This 
term, however, doesnot affect the stability analysis since it has an C2 gain. n 



Remark 6.5.1 In the analysis of the MRAC schemes in this section we 
assume that the nonlinear differential equations describing the stability 
properties of the schemes possess a unique solution. This assumption 
is essential for the validity of our analysis. We can establish that these 
differential equations do possess a unique solution by using the results 
on existence and uniqueness of solutions of adaptive systems given in 
[191]. 

6.5.4 Effect of Initial Conditions 

The analysis of the direct MRAC schemes with normalized adaptive laws 
presented in the previous sections is based on the assumption that the ini- 
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tial conditions for the plant and reference model are equal to zero. This 
assumption allows us to use transfer function representations and other I/O 
tools that help improve the clarity of presentation. 

Nonzero initial conditions introduce exponentially decaying to zero terms 
in the parametric models (6.5.40) and (6.5.41) as follows: 



ei = Wm{s)p*[up-6*^u] + et 



p 
z = e* ' (/>p + et (6.5.52) 



where et = Cj{sl — Ac)~^e{0) and Ac,e{0) are as defined in Section 6.4. 
Because A^ is a stable matrix, the properties of the adaptive laws based on 
(6.5.52) with e^ = remain unchanged when e^ / as established in Section 
4.3.7. Similarly, the et terms also appear in (6.5.42) and (6.5.43) as follows: 

Vp = Wm{s){r+—6'^uj) + et 

Up = G-\s)Wra{s){r + \¥ u) + et (6.5.53) 

where in this case et denotes exponentially decaying to zero terms because of 
nonzero initial conditions. The exponentially decaying term only contributes 
to the constant in the inequality 

m^ < c+ et^ 2 ll"^/lP + Q^o" '^ll^^'/lP 

where ^ G £2- Applying the B-G Lemma to the above inequality we can 
establish, as in the case of et = 0, that rrif G £00 • Using m,j £ C^o, the 
rest of the analysis follows using the same arguments as in the zero initial 
condition case. 



6.6 Indirect MRAC 

In the previous sections, we used the direct approach to develop stable 
MRAC schemes for controlling a wide class of plants with unknown parame- 
ters. The assumption on the plant and the special form of the controller en- 
abled us to obtain appropriate parameterizations for the unknown controller 
vector 6* that in turn allows us to develop adaptive laws for estimating the 
controller parameter vector 9{t) directly. 
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An alternative way of controlling the same class of plants is to use the 
indirect approach, where the high frequency gain kp and coefficients of the 
plant polynomials Zp(s), Rp{s) are estimated and the estimates are, in turn, 
used to determine the controller parameter vector 9(t) at each time t. The 
MRAC schemes based on this approach are referred to as indirect MRAC 
schemes since 9(t) is estimated indirectly using the plant parameter esti- 
mates. 

The block diagram of an indirect MRAC scheme is shown in Figure 6.15. 
The coefficients of the plant polynomials Zp(s),Rp(s) and high frequency 
gain kp are represented by the vector 9* The on-line estimate 9p(t) of 9*, 
generated by an adaptive law, is used to calculate the controller parameter 
vector 6(t) at each time t using the same mapping f : 9p >-^ 9 as the mapping 
f : 9* !—>■ 6* defined by the matching equations (6.3.12), (6.3.16), (6.3.17). 
The adaptive law generating 9p may share the same filtered values of Up,yp, 
i.e., uJi,uJ2 as the control law leading to some further interconnections not 
shown in Figure 6.15. 

In the following sections we develop a wide class of indirect MRAC 
schemes that are based on the same assumptions and have the same sta- 
bility properties as their counterparts direct MRAC schemes developed in 
Sections 6.4 and 6.5. 

6.6.1 Scalar Example 

Let us consider the plant 

X = ax + hu (6.6.1) 

where a, h are unknown constants and sgn(6) is known. It is desired to choose 
u such that all signals in the closed-loop plant are bounded and the plant 
state X tracks the state x^ of the reference model 

Xm = -amXm + bmT (6.6.2) 

where Um > 0, bm and the reference input signal r are chosen so that Xm{t) 
represents the desired state response of the plant. 

Control Law As in Section 6.2.2, if the plant parameters a, h were known, 
the control law 

u=-k*x + rr (6.6.3) 
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Figure 6.15 Block diagram of an indirect MRAC scheme. 



with 






(6.6.4) 



could be used to meet the control objective. In the unknown parameter case, 
we propose 

u = -k{t)x + l{t)r (6.6.5) 

where k(t),l(t) are the on-line estimates of k*,l* at time t, respectively. In 
direct adaptive control, k(t),l(t) are generated directly by an adaptive law. 
In indirect adaptive control, we follow a different approach. We evaluate 
k(t),l(t) by using the relationship (6.6.4) and the estimates a,b of the un- 
known parameters o, b as follows: 



m bit) 



(6.6.6) 
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where d, b are generated by an adaptive law that we design. 

Adaptive Law The adaptive law for generating d, b is obtained by following 
the same procedure as in the identification examples of Chapter 4, i.e., we 
rewrite (6.6.1) as 

X = [{a + am)x + bu] 

s + am 

and generate x, the estimate of x, from 

[(d + am)x + bu] = Xm (6.6.7) 



s + a„ 



where the last equality is obtained by using (6.6.5), (6.6.6). As in Section 
6.2.2, the estimation error ti = x — Xm = ei is the same as the tracking error 
and satisfies the differential equation 

ei = —ttmei — ax — bu (6.6.8) 

where 

A . ~ A ^ 

a = a — a, b = b — b 

are the parameter errors. Equation (6.6.8) motivates the choice of 

V = l(el + '^+'-] (6.6.9) 

for some 71,72 > 0, as a potential Lyapunov-like function candidate for 
(6.6.8). The time derivative of V along any trajectory of (6.6.8) is given by 

2 ~ aa bb 
V = —amGi — axei — buei H \ (6.6.10) 

71 72 



Hence, for 



we have 



a = a = 7ieix, b = b = 7261^ (6.6.11) 



V = —am^i < 



which implies that ei,a,b G £00 and that ei G £2 by following the usual 
arguments. Furthermore, Xm,ei £ £00 imply that x G Coo- The bound- 
edness of n, however, cannot be established unless we show that k{t),l{t) 
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are bounded. The boundedness of j- and therefore of k{t),l{t) cannot be 
guaranteed by the adaptive law (6.6.11) because (6.6.11) may generate esti- 
mates b(t) arbitrarily close or even equal to zero. The requirement that b(t) 
is bounded away from zero is a controllability condition for the estimated 
plant that the control law (6.6.5) is designed for. One method for avoid- 
ing b(t) going through zero is to modify the adaptive law for b(t) so that 
adaptation takes place in a closed subset of 7Z^ which doesnot include the 
zero element. Such a modification is achieved by using the following a priori 
knowledge: 

The sgn(6) and a lower bound 6o > for \b\ is known (A2) 

Applying the projection method with the constraint b sgn(6) > 69 to the 
adaptive law (6.6.11), we obtain 



7ieix, b 



^2''^'' if |6| = 60 and eiu sgn(6) > (6.6.12) 



if |6| > 60 or 
if \b\ = bo 
otherwise 

where 6(0) is chosen so that 6(0)sgn(6) > 6o- 

Analysis It follows from (6.6.12) that if 6(0)sgn(6) > 60, then whenever 
b{t)sgn(b) = \b{t)\ becomes equal to 69 we have bb > which implies that 
1^(^)1 ^ ^0) Vt > 0. Furthermore the time derivative of (6.6.9) along the 
trajectory of (6.6.8), (6.6.12) satisfies 

• _ J —amGi if |6| > bo or |fe| = 69 and eiu sgn{b) > 

[ — fflmCi — beiu if |6| = 60 and eiu sgn(6) < 

Now for |fc| = bo, we have (6 — 6)sgn(6) < 0. Therefore, for |6| = 69 and 
eiu sgn(6) < 0, we have 

beiu = (b — b)eiu = ib — 6)sgn(6)(einsgn(6)) > 

which implies that 

V < -amcj < 0, Vt > 

Therefore, the function V given by (6.6.9) is a Lyapunov function for the 
system (6.6.8), (6.6.12) since u,x in (6.6.8) can be expressed in terms of ei 
and Xm where Xm(t) is treated as an arbitrary bounded function of time. 
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Figure 6.16 Block diagram for implementing the indirect MRAC scheme 
given by (6.6.5), (6.6.6), and (6.6.12). 



Hence the equilibrium eie = 0,ae = a,be = b is u.s. and ei,b,a e /Zoo- 
Using the usual arguments, we have ei £ £2 and ei G £00 which imply that 
ei(f) = x(t) — Xm{t) ^ as t ^ cx) and therefore that a(t),b(t) ^ as 
t —I- 00. 

As in the direct case it can be shown that if the reference input signal 
r(t) is sufficiently rich of order 2 then b, a and, therefore, k, I converge to 
zero exponentially fast. 

Implementation The proposed indirect MRAC scheme for (6.6.1) described 
by (6.6.5), (6.6.6), and (6.6.12) is implemented as shown in Figure 6.16. 



6.6.2 Indirect MRAC with Unnormalized Adaptive Laws 

As in the case of direct MRAC considered in Section 6.5, we are interested 
in extending the indirect MRAC scheme for the scalar plant of Section 6.6.1 
to a higher order plant. The basic features of the scheme of Section 6.6.1 is 
that the adaptive law is driven by the tracking error and a single Lyapunov 
function is used to design the adaptive law and establish signal boundedness. 
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In this section, we extend the results of Section 6.6.1 to plants with 
relative degree n* = 1. The same methodology is applicable to the case of 
n* > 2 at the expense of additional algebraic manipulations. We assign these 
more complex cases as problems for the ambitious reader in the problem 
section. 

Let us start by considering the same plant and control objective as in 
the direct MRAC scheme of Section 6.4.1 where the relative degree of the 
plant is assumed to be n* = 1. We propose the same control law 



(6.6.13) 



as in the direct MRAC case where 6(t) is calculated using the estimate of kp 
and the estimates of the coefficients of the plant polynomials Zp(s),Rp{s), 
represented by the vector 9p{t), at each time t. Our goal is to develop an 
adaptive law that generates the estimate Op(t) and specify the mapping from 
9p{t) to 9(t) that allows us to calculate 9(t) at each time t. We start with 

the mapping that relates the unknown vectors 9* = 91 , ^2 1 ^3 > Cq and 
9* specified by the matching equations (6.3.12), (6.3.16), and (6.3.17) (with 
Q(s) = 1 due to n* = 1), i.e.. 



Wl = 


= Fuji + gUp, 


cJi(O) = 


= 


i02 - 


= Fuj2 + gyp, 


MO) = 


= 


U„ = 


= 9'^LJ 









4 


km 








efais) 


= Hs)- 


Zp{s), 






9fais) + 9*Ais) 


Rp{s)- 


- Ao{s)R„, 
kp 


■is) 


To 


simplify (6.6.14) further, we 


express Z 


p{s), Rp{s) 


, A' 


as 












Zp{s) = s^ 


~^+pJan. 


-2{S) 






Rp{s) = s^ 


+ On-is"" 


"^ +pjan- 


.2(^: 




A(s) = s" 


"^ + A^a„ 


-2{S) 






Ao{s)Rm{s) = s" 


+ r„_is"- 


^ + 1^'^an- 


2(^; 



(6.6.14) 



Ao(s)i?m(s) 



where pi, p2 ^71"' ]an-i are the plant parameters, i.e., 9* = [kp,pJ,an-i,P2V', 
X,v ^ 7l^~^ and r„_i are the coefficients of the known polynomials A(s), 
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Ao(s)i?m(s) and a„_2(s) = [s"~^, s""^, . . . , ■§, l] , which we then substitute 
in (6.6.14) to obtain the equations 



Co 

0*2 



kp 

A- Pi 

P2 - an-lX + rn-lX - V 

kp 

a-n-l - Tn-l 

kp 



(6.6.15) 



If we let kp{t),pi{t),p2{t),an-i{t) be the estimate of kp,pi,p2,an-i re- 
spectively at each time t, then 9{t) = [Oj ,$2 ,63,co\~^ may be calculated 
as 



co(t) = 


km 

kpit) 




Oiit) -- 


= A-pi(i) 




02{t) -- 


P2{t) - an-i{t)X + r-n-iX - 


- u 


kit) 




a„fA - 


a„_i(t) - r„_i 





(6.6.16) 

Kp[t) 
rn-1 
kp{t) 

provided \kp{t)\ / 0, Vt > 0. 

The adaptive laws for generating pi,p2,an-i,kp on-hne can be devel- 
oped by using the techniques of Chapter 4. In this section we concentrate 
on adaptive laws that are driven by the tracking error ei rather than the 
normalized estimation error, and are developed using the SPR-Lyapunov 
design approach. We start with the parametric model given by equation 
(6.4.6), i.e., 

ei = Wmis)p*iup-9*^Lj) (6.6.17) 

where P* = -^ = ^- As in the direct case, we choose Wm{s), the transfer 
function of the reference model, to be SPR with relative degree n* = 1. 
The adaptive law for 9p = [kp,pj ,an-i,P2]'^ is developed by first relating 
ei with the parameter error Op = Op — 6* through the SPR transfer function 
Wmis) and then proceeding with the Lyapunov design approach as follows: 
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We rewrite (6.6.17) as 

ei = Wm{s)- — (kpUp — kp6* uj — kpUp + kpO uj\ (6.6.18) 



where —kpUp + kpO a; = because of (6.6.13). If we now substitute for 
kp6*,kp6 from (6.6.15) and (6.6.16), respectively, in (6.6.18) we obtain 

ei=Wrn{s)—\kJ^X^iJi-UpyrpjL02+an-{yp-X^uJ2ykppJuJi+kppJuJi 



kn. 

where kp = kp — kp,p2 = P2 — P2,ffln-i = On-i — o-n-i are the parameter 
errors. Because —kppju>i + kppjuji + kppjuji — kppju>i = —kppJuJi — kppjuji 
we have 

ei = Wm(s)-— Ikp^i + an-i£.2 +P2^2 " kppj ujA (6.6.19) 

l^m '- -' 

where 

^1 = A LOl -Up- PiUJl, ^2 = yp-\ W2, Pi = Pi- Pi 

A minimal state-space representation of (6.6.19) is given by 

e = Ace + Be ^kp^i + an-ii2 + pJuj2 - kppjui^ 
ei = Cje (6.6.20) 

where Cj {si — Ac)~^Bc = Wm{s)-^. Defining the Lyapunov-like function 

y_ e^Pce ~kl al_i Pi^I^Pi n^^ , P2^2^P2 
2 27p 271 2 ' ^' 2 

where Pc = Pj > satisfies the algebraic equations of the LKY Lemma, 
71) 7p > and Fj = TJ > 0, i = 1, 2, it follows that by choosing the adaptive 
laws 

fln-i = -7iei6 

Pi = TiduJi sgn(kp) 

§2 = -T2eiuJ2 (6.6.21) 

-7peiCi if l^pl > ^0 
kp = \ or if \kp\ = fco and ei^i sgn(fcp) < 

otherwise 
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where fcp(O) sgn(kp) > /cq > and ko is a known lower bound for \kp\, we 
have 



V = i 



-e^2i_e — i/^e^ ^e if |A:p| > or if \kp\ = ko and 

ei,^i sgn(/cp) < 
-e^2i_e — ^/^e^^e + ei^ifcp if \kp\ = ko and ei^i sgn(A;p) > 



where the scalar Uc > 0, matrix Lc = LJ > and vector q are defined in the 
LKY Lemma. 

Because for ei^i sgn(A;p) > and \kp\ = ko we have (fcp — kp) sgn{kp) < 
and ei^ikp < 0, it follows that 

V < -I'c— T^ 

2 

which implies that ei,e,an-i,Pi,P2,kp E Coo and e, ei E C^- As in Section 
6.4.1, ei e £oo implies that yp.,uji,uj2 £ ^oo, which, together with 6 e £oo 
(guaranteed by (6.6.16) and the boundedness of 0p, J-), implies that np G 
Coo- Therefore, all signals in the closed-loop system are bounded. The 
convergence of ei to zero follows from ei G C2 and ei G £00 guaranteed by 
(6.6.18). 

We summarize the stability properties of above scheme, whose main equa- 
tions are listed in Table 6.8, by the following theorem. 

Theorem 6.6.1 The indirect MRAC scheme shown in Table 6.8 guarantees 
that all signals are u.h., and the tracking error ei converges to zero as t ^ 00. 

We should note that the properties of Theorem 6.6.1 are established un- 
der the assumption that the calculation of 6(t) is performed instantaneously. 
This assumption is quite reasonable if we consider implementation with a 
fast computer. However, we can relax this assumption by using a hybrid 
adaptive law to update Op at discrete instants of time thus providing suffi- 
cient time for calculating 6{t). The details of such a hybrid scheme are left 
as an exercise for the reader. 

As in the case of the direct MRAC schemes with unnormalized adaptive 
laws, the complexity of the indirect MRAC without normalization increases 
with the relative degree n* of the plant. The details of such schemes for the 
case of n* = 2 and higher are given as exercises in the problem section. 
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Table 6.8 Indirect MRAC scheme with unnormalized adaptive 

law for n* = 1 



Plant 






Reference 
model 



Zrnjs) 



ym = Wm{s)r, Wm{s)=km^ 



Control law 



wi = Fuji + 9Up 
UJ2 = Fuj2 + gvp 



Ur 



^1 ,02 J^S^Co 



;w 



[^i,^2,yp,rr 



Adaptive law 



. i-lpeiCi if |A:p| > A;o or 

kp = \ if \kp\ = ko and ei.^isgn(A;p) < 

otherwise 

On-i = -7iei6 

Pi = Tiduji sgn(kp) 

P2 = -r2eia;2 

ei=yp- Vrn 

^1 = X^uji -Up- pjuji; £.2 = yp- A'^u;2 



Calculation 

of e{t) 



co(t) = km/kp(t) 

eiit) = X-piit) 

02{t) = {P2{t) - a„_i(t)A + r„_iA - u)/kp{t) 

^3(t) = (a„_i(t)-r„_i)/fcp(t) 



Design 
variables 



fco '■ lower bound for |fcp| > A:o > 0; A £ 7^" : coeffi 



cient vector of A(s) — s 



n-l. 



-1 e 71} : coefficient of 



,n-l 



in Ao(s)i?m(s); u £ 7?." : coefficient vector of 



Section 6.4.1 



r^-is" ; A(s), Ao(s) as defined in 
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Another interesting class of indirect MRAC schemes with unnorniahzed 
adaptive laws is developed in [116, 117, 118] using a systematic recursive 
procedure, called backstepping. The procedure is based on a specific state 
space representation of the plant and leads to control and adaptive laws that 
are highly nonlinear. 

6.6.3 Indirect MRAC with Normalized Adaptive Law 

As in the direct MRAC case, the design of indirect MRAC with normalized 
adaptive laws is conceptually simple. The simplicity arises from the fact that 
the control and adaptive laws are designed independently and are combined 
using the certainty equivalence approach. As mentioned earlier, in indirect 
MRAC the adaptive law is designed to provide on-line estimates of the high 
frequency gain kp and of the coefficients of the plant polynomials Zp(s), Rp{s) 
by processing the plant input and output measurements. These estimates 
are used to compute the controller parameters at each time t by using the 
relationships defined by the matching equations (6.3.12), (6.3.16), (6.3.17). 
The adaptive law is developed by first expressing the plant in the form 
of a linear parametric model as shown in Chapters 2, 4, and 5. Starting with 
the plant equation (6.3.2) that we express in the form 



Vp 



s" + a„_is"-i + ■ ■ ■ + ao 



where br, 



kp is the high frequency gain, and using the results of Sec- 



tion 2.4.1 we obtain the following plant parametric model: 



rp'^c 



(6.6.22) 



where 



Ap(s 



■Vp, 



a„_i(s) K-i{s) 



Up, 



Ap(s) "' Ap(s) 
6* = [0,. ..,0,bm,-- ■ 1 h, ffln-i, • • • , ao]^ 

n—m—l 



Vp 



and Ap(s) = s" + Ap a„_i(s) with Xp = [A„_i, . . . 
mial. Since in this case m is known, the first n 
known to be equal to zero. 



, Ao] ^ is a Hurwitz polyno- 
-777.-1 elements of 6* are 
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The parametric model (6.6.22) may be used to generate a wide class of 
adaptive laws by using Tables 4.2 to 4.5 from Chapter 4. Using the estimate 
0p{t) of 6*, the MRAC law may be formed as follows: 

The controller parameter vectors 9i{t),92{t),93{t),co{t) in the control 
law 

whereu;= [^^^^p, iv(^yp,yp>^] , a(s) = a„_2(s) and 6*= [6*7, ^^J, 613,00]^ is 
calculated using the mapping 9(t) = f{9p{t)). The mapping /(•) is obtained 
by using the matching equations (6.3.12), (6.3.16), (6.3.17), i.e.. 



L-0 

3*T 



kp 



a*T„v„^ , a*,t.^ _ Q{s)Rp{s) - Kq{s)R^{s) 

Kp 



1\ ' a{s) = A(s) - Zp{s)Q{s) (6.6.24) 

9V a{s) + eiK{s) = 

where Q{s) is the quotient of ^^^j|^ and A(s) = Ao(s)Zm(s). That is, if 

Rp{s, t), Zp(s, t) are the estimated values of the polynomials Rp{s), Zp{s) = 
kpZp(s) respectively at each time t, then 00,^1,^2,^3 are obtained as solu- 
tions to the following polynomial equations: 

km 
Up 

9ja{s) = A{s)- ^Zp{s,t)-Q{s,t) (6.6.25) 

kp 

9j a{s) + 9sA{s) = j-[Q{s,t) ■ Rp{s,t) - Ao{s)Rm{s)] 
kp 



provided kp / 0, where Q{s,t) is the quotient of "a / "\ ■ Here A{s,t) 



Ao{s)R„As) 
Rp{s,t) 
B(s, t) denotes the frozen time product of two operators yl(s, t), B{s, t). 

The polynomials Rp{s,t), Zp(s,t) are evaluated from the estimate 
9p = [0, . . . , 0, bm, . . ■ ,bo, d„_i, . . . , ao] 

n—m—l 

of 9*p, i.e., 

Rp{s, t) = s"- + a„_is""^ + ■ ■ ■ + ao 



6.6. INDIRECT MRAC 409 



Zpis, t) = hrnS"^ + brr.-is'^-^ + ■ ■ ■ + k 
Kp = Om 

As in Section 6.6.2, the estimate bm = kp should be constrained from going 
through zero by using projection. 

The equations of the indirect MRAC scheme are described by (6.6.23), 
(6.6.25) where 9 is generated by any adaptive law from Tables 4.2 to 4.5 based 
on the parametric model (6.6.22). Table 6.9 summarizes the main equations 
of an indirect MRAC scheme with the gradient algorithm as the adaptive 
law. Its stability properties are summarized by the following theorem: 

Theorem 6.6.2 The indirect MRAC scheme summarized in Table 6.9 guar- 
antees that all signals are u.b., and the tracking error ei = Vp — ym converges 
to zero as t ^ oo. 

The proof of Theorem 6.6.2 is more complex than that for a direct MRAC 
scheme due to the nonlinear transformation 9p i-^ 6. The details of the 
proof are given in Section 6.8. The number of filters required to generate 
the signals lj, (p in Table 6.9 may be reduced from 4n — 2 to 2n by selecting 
Ap(s) = (s + Ao)A(s) for some Aq > and sharing common signals in the 
control and adaptive law. 

Remark 6.6.1 Instead of the gradient algorithm, a least-squares or a hy- 
brid adaptive law may be used in Table 6.9. The hybrid adaptive law 
will simplify the computations considerably since the controller param- 
eter vector 9 will be calculated only at discrete points of time rather 
than continuously. 

The indirect MRAC scheme has certain advantages over the correspond- 
ing direct scheme. First, the order of the adaptive law in the indirect case 
is n + m + 1 compared to 2n in the direct case. Second, the indirect scheme 
allows us to utilize any apriori information about the plant parameters to 
initialize the parameter estimates or even reduce the order of the adaptive 
law further as indicated by the following example. 

Example 6.6.1 Consider the third order plant 

yp = ^^(i^f^ (6.6.26) 
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Table 6.9 Indirect MRAC scheme with normalized adaptive law 



Plant 



Vp = Gp{s)up, Gp{s) = Zp{s)/Rp{s), Zp{s) = kpZp{s) 



Reference 
model 






Control 
law 



n„ 



CO 



UJl 



9'uj 

^i,^2^yp^i^] ' 6* = ^6^7, 6* J, 6*3, Co] 

A(s) Up, ^2 - A(^) Vp 



Adaptive 
law 



Pi = ri(/>ie, P2 = r202e 
. 7me0im if \kp\ > ko or 

kp = \ if \kp\ = ko and (/>imesgn(A;j, 

otherwise 

kp{0)sgn{kp) >ko>0 
t= {z- z)lrr?, z = yp + Xj(f)2 



> 



(p, m 



1 + 



aT, 



^J,^IV 



[0,...,0,kp,pl ,p\ 



T ^TlT 



^1 



n—m—1 
an-i{s) 



Ap{4. ^P' 



^2 = -^^yp 

'/'im £ T^^ is the last element of (J)q 

pi = [bm-i,---,bo]'^,P2 = [a„_i,...,ao]^ 

Zp{s,t) = kps'^+pJam-iis),Rp{s,t) = s'^+P2an-iis) 



Calculation 
of 



Ms) 



-Zp{s,t) -(9(8, t) 



ej{t)an-2is) - ..yaj - J^-pV 

6j{t)an-2{s) + 03{t)A{s) 

= f (g(s, t) ■ Rp{s, t) - Aois)Rmis)) 

Q(s,t) = quotient of Ao(s)i?m(s)/i?p(s, i) 



ko: lower bound for \kp\ > ko > 0; Ap(s): monic Hurwitz 
of degree n; For simplicity, Ap(s) = (s + Ao)A(s), Aq > 0; 

A(s)=Ao(s)z^(s);ri=r7>o,r2=rJ>0;rie7e™><™, 

r2 e TZ"-^"'; \p e T?.** is the coefficient vector of Ap(s)-s" 



Design 
variables 
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where a is the only unknown parameter. The output j/j, is required to track the 
output of ym of the reference model 

1 



(s + 2)3 



The control law is given by 

^p = ^" (7TXo^"p+^i2 (7Tao^"^+^^^ (7^^^+^^^ (TTa^ 

where = [^n, ^12, 6'2i, ^'22, ^3, cq]^ G U^. In direct MRAC, 6 is generated by a 
sixth-order adaptive law. In indirect MRAC, 9 is calculated from the adaptive law 
as follows: 

Using Table 6.9, we have 

^p= [0,0,1, a, 0,0]^ 
a = ja(t)ae 



z — z 



1 



, z = dJ(t>, z = yp + XJ(t>2 



where Ap(s) is chosen as Ap{s) = {s + Xi)^, Xp = [3Ai,3A^, Af]^. 

„2 



0a = [0,0,0, 1,0,0,](^: 



iVp 



and 7a > is a constant. The controller parameter vector is calculated as 



co = i, ej 



(s + Ai)2-Q(s,t) 



+ 6*3(5 + Xif = Q{s, t) ■ [s^ + as^] - (s + Xif{s + 2)= 



where Q{s,t) is the quotient of 



(s+Ai)^(^+2)-'' 



V 



The example demonstrates that for the plant (6.6.26), the indirect scheme 
requires a first order adaptive law whereas the direct scheme requires a sixth- 
order one. 
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6.7 Relaxation of Assumptions in MRAC 

The stability properties of the MRAC schemes of the previous sections are 
based on assumptions PI to P4, given in Section 6.3.1. While these as- 
sumptions are shown to be sufficient for the MRAC schemes to meet the 
control objective, it has often been argued whether they are also necessary. 
We have already shown in the previous sections that assumption P4 can be 
completely relaxed at the expense of a more complex adaptive law, therefore 
P4 is no longer necessary for meeting the MRC objective. In this section we 
summarize some of the attempts to relax assumptions PI to P3 during the 
1980s and early 1990s. 

6.7.1 Assumption PI: Minimum Phase 

This assumption is a consequence of the control objective in the known 
parameter case that requires the closed-loop plant transfer function to be 
equal to that of the reference model. Since this objective can only be achieved 
by cancelling the zeros of the plant and replacing them by those of the 
reference model, Zp(s) has to be Hurwitz, otherwise zero-pole cancellations 
in C^ will take place and lead to some unbounded state variables within the 
closed- loop plant. The assumption of minimum phase in MRAC has often 
been considered as one of the limitations of adaptive control in general, rather 
than a consequence of the MRC objective, and caused some confusion to 
researchers outside the adaptive control community. One of the reasons for 
such confusion is that the closed-loop MRAC scheme is a nonlinear dynamic 
system and zero-pole cancellations no longer make much sense. In this case, 
the minimum phase assumption manifests itself as a condition for proving 
that the plant input is bounded by using the boundedness of other signals 
in the closed-loop. 

For the MRC objective and the structures of the MRAC schemes pre- 
sented in the previous sections, the minimum phase assumption seems to be 
not only sufficient, but also necessary for stability. If, however, we modify 
the MRC objective not to include cancellations of unstable plant zeros, then 
it seems reasonable to expect to be able to relax assumption PI. For exam- 
ple, if we can restrict ourselves to changing only the poles of the plant and 
tracking a restricted class of signals whose internal model is known, then we 
may be able to allow plants with unstable zeros. The details of such designs 
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that fall in the category of general pole placement are given in Chapter 7. 
It has often been argued that if we assume that the unstable zeros of the 
plant are known, we can include them to be part of the zeros of the reference 
model and design the MRC or MRAC scheme in a way that allows only the 
cancellation of the stable zeros of the plant. Although such a design seems 
to be straightforward, the analysis of the resulting MRAC scheme requires 
the incorporation of an adaptive law with projection. The projection in turn 
requires the knowledge of a convex set in the parameter space where the es- 
timation is to be constrained. The development of such a convex set in the 
higher order case is quite awkward, if possible. The details of the design and 
analysis of MRAC for plants with known unstable zeros for discrete-time 
plants are given in [88, 194]. 

The minimum phase assumption is one of the main drawbacks of MRAC 
for the simple reason that the corresponding discrete-time plant of a sampled 
minimum phase continuous-time plant is often nonminimum phase [14]. 

6.7.2 Assumption P2: Upper Bound for the Plant Order 

The knowledge of an upper bound n for the plant order is used to determine 
the order of the MRC law. This assumption can be completely relaxed if the 
MRC objective is modified. For example, it has been shown in [102, 159, 160] 
that the control objective of regulating the output of a plant of unknown 
order to zero can be achieved by using simple adaptive controllers that are 
based on high-gain feedback, provided the plant is minimum phase and the 
plant relative degree n* is known. The principle behind some of these high- 
gain stabilizing controllers can be explained for a minimum phase plant with 
n* = 1 and arbitrary order as follows: Consider the following minimum phase 
plant with relative degree n* = 1: 

From root locus arguments, it is clear that the input 

Up = -OypSgn{kp) 
with sufficiently large gain 6 will force the closed loop characteristic equation 

Rp{s) + \kp\eZp{s) = 
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to have roots in Re [s] < 0. Having this result in mind, it can be shown that 
the adaptive control law 

Up = - OypSgn (kp) , = vl 

can stabilize any minimum phase plant with n* = 1 and of arbitrary or- 
der. As n* increases, the structure and analysis of the high gain adaptive 
controllers becomes more complicated [159, 160]. 

Another class of adaptive controllers for regulation that attracted con- 
siderable interest in the research community is based on search methods and 
discontinuous adjustments of the controller gains [58, 137, 147, 148]. Of par- 
ticular theoretical interest is the controller proposed in [137] referred to as 
universal controller that is based on the rather weak assumption that only 
the order Uc of a stabilizing linear controller needs to be known for the sta- 
bilization and regulation of the output of the unknown plant to zero. The 
universal controller is based on an automated dense search throughout the 
set of all possible nc-order linear controllers until it passes through a subset 
of stabilizing controllers in a way that ensures asymptotic regulation and the 
termination of the search. One of the drawbacks of the universal controller is 
the possible presence of large overshoots as pointed out in [58] which limits 
its practicality. 

An interesting MRAC scheme that is also based on high gain feedback 
and discontinuous adjustment of controller gains is given in [148]. In this 
case, the MRC objective is modified to allow possible nonzero tracking errors 
that can be forced to be less than a prespecified (arbitrarily small) constant 
after an (arbitrarily short) prespecified period of time, with an (arbitrarily 
small) prespecified upper bound on the amount of overshoot. The only 
assumption made about the unknown plant is that it is minimum phase. 

The adaptive controllers of [58, 137, 147, 148] where the controller gains 
are switched from one constant value to another over intervals of times based 
on some cost criteria and search methods are referred to in [163] as non- 
identifier-has ed adaptive controllers to distinguish them from the class of 
identifier-has ed ones that are studied in this book. 

6.7.3 Assumption P3: Known Relative Degree n* 

The knowledge of the relative degree n* of the plant is used in the MRAC 
schemes of the previous sections in order to develop control laws that are free 
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of differentiators. This assumption may be relaxed at the expense of addi- 
tional complexity in the control and adaptive laws. For the identifier-based 
schemes, several approaches have been proposed that require the knowledge 
of an upper bound n* for n* [157, 163, 217]. In the approach of [163], n* 
parameterized controllers Ci,i = 1,2, ... jU'^ are constructed in a way that 
Ci can meet the MRC objective for a reference model Mj of relative degree i 
when the unknown plant has a relative degree i. A switching logic with hys- 
teresis is then designed that switches from one controller to another based 
on some error criteria. It is established in [165] that switching stops in finite 
time and the MRC objective is met exactly. 

In another approach given in [217], the knowledge of an upper bound n* 
and lower bound n^ of n* are used to construct a feedforward dynamic term 
that replaces Cor in the standard MRC law, i.e., Up is chosen as 

where fei(s) = 1, s, . . . , s"* ,n* = n* — n^ , 0| G 7l"-*~^^ and ni{s) is an 
arbitrary monic Hurwitz polynomial of degree n^. The relative degree of 
the transfer function Wmis) of the reference model is chosen to be equal to 
n*. It can be shown that for some constant vectors 91,02,91,04 the MRC 
objective is achieved exactly, provided 02 is chosen so that kp9l^bi{s) is a 
monic Hurwitz polynomial of degree n* — n'^ < n* , which implies that the 
last n* — n* — n^ elements of 9* are equal to zero. 

The on-line estimate ^^ of ^* , i = 1 , . . . , 4 is generated by an adaptive law 
designed by following the procedure of the previous sections. The adaptive 
law for 04, however, is modified using projection so that 04 is constrained 
to be inside a convex set C which guarantees that fcp0j6i(s) is a monic 
Hurwitz polynomial at each time t. The development of such set is trivial 
when the uncertainty in the relative degree, i.e., n* is less or equal to 2. For 
uncertainties greater than 2, the calculation of C, however, is quite involved. 

6.7.4 Tunability 

The concept of tunability introduced by Morse in [161] is a convenient tool for 
analyzing both identifier and nonidentifier-based adaptive controllers and for 
discussing the various questions that arise in conjunction with assumptions 
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PI to P4 in MRAC. Most of the adaptive control schemes may be represented 
by the equations 

X = A{e)x + B{e)r 
ei = C{e)x (6.7.1) 

where 9 : TZ'^ >-^ TZ"" is the estimated parameter vector and ei is the estima- 
tion or tuning error. 

Definition 6.7.1 [161, 163] The system (6.7.1) is said to be tunable on a 
subset S C 7?-" if for each 9 ^ S and each bounded input r, every possible 
trajectory of the system for which ei(t) = 0, t e [0, oo) is bounded. 

Lemma 6.7.1 The system (6.7.1) is tunable onS if and only if {C {9) ,A{9)\ 
is detectable for each ^ S. 

If {C{9), A(0)} is not detectable, then it follows that the state x may grow un- 
bounded even when adaptation is successful in driving ei to zero by adjusting 
9. One scheme that may exhibit such a behavior is a MRAC of the type 
considered in previous sections that is designed for a nonminimum-phase 
plant. In this case, it can be established that the corresponding system of 
equations is not detectable and therefore not tunable. 

The concept of tunability may be used to analyze the stability properties 
of MRAC schemes by following a different approach than those we discussed 
in the previous sections. The details of this approach are given in [161, 163] 
where it is used to analyze a wide class of adaptive control algorithms. The 
analysis is based on deriving (6.7.1) and establishing that {C(9),A(9)} is 
detectable, which implies tunability. Detectability guarantees the existence 
of a matrix H(9) such that for each fixed 9 ^ S the matrix Ac{9) = A(9) — 
H{9)C{9) is stable. Therefore, (6.7.1) may be written as 

x = [A (9) - H{9)C{9)] X + B{9)r + H{9)ei (6.7.2) 

by using the so called output injection. Now from the properties of the adap- 
tive law that guarantees ^, — G £2 where m = 1 + (Cj x)"^ for some vector 
Co, we can establish that the homogeneous part of (6.7.2) is u.a.s., which, 
together with the B-G Lemma, guarantees that x e £00 • The boundedness 
of x can then be used in a similar manner as in the previous sections to es- 
tablish the boundedness of all signals in the closed loop and the convergence 
of the tracking error to zero. 
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6.8 Stability Proofs of MRAC Schemes 

6.8.1 Normalizing Properties of Signal ruf 

In Section 6.5, we have defined the fictitious normalizing signal nif 

m}^l + \\u,f+\\y,f (6.8.1) 

where || • || denotes the >C2<5-norm, and used its normalizing properties to establish 
stability of the closed-loop MRAC for the adaptive tracking and regulation exam- 
ples. We now extend the results to the general SISO MRAC scheme as follows: 

Lemma 6.8.1 Consider the plant equation (6.3.2) and control law (6.5.39). There 
exists a 5 > Q such that: 

(i) UJi/mf,UJ2/mf G Coo- 

(ii) If e Coo, then Up/mf,yp/mf,Lu/mf,W{s)uj/mf G £00 where W{s) is a 

proper transfer function with stable poles. 
(iii) //r, 6 G £00; then in addition to (i) and (ii), we have ||j/jj||/w/, ||a;||/m/ G £00- 



Proof (i) Because 



a{s) a{s) 



and each element of ^W has relative degree greater or equal to 1, it follows from 
Lemma 3.3.2 and the definition of nif that LUi/mf,uj2/mf G C^c- 
(ii) We can apply Lemma 3.3.2 to equation (6.5.42), i.e., 

yp = Wm{s) (r+—Fuj 
\ % 

to obtain (using 6 G >Coo) that 

\yp{t)\ <c + c||^^cc;|| <c+c||cc;|| 

where c > denotes any finite constant and || • || the C25 norm. On the other hand, 
we have 

ll^ll < llc^ill + 11^211 + hpW + \\r\\ < c\\up\\ + c\\yp\\ +c<cmf + c 

therefore, -^ G Coo- Because uj = [ujJ ,ojJ ,yp,r]^ and uji/nif, ijj2/mf, yp/nif, 
r/rrif G Coo, it follows that uj/mf G Coo- From Up = uj and uj/mf,0 G £00 we 
conclude that Up/mf G Coo- Consider (j) = W{s)ijJ. We have \(j)\ < c\\lu\\ for some 
(5 > such that W{s — |) is stable. Hence, ^ G Coo due to ||aj||/m/ G Co 



--oo • 
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(iii) Note that i/p = sW„i{s)[r + ■\6'^Llj] and sWmis) is a proper stable transfer 
function, therefore from Lemma 3.3.2 we have 

ll^pll < c+c\\d'^uj\\ < c+cnif 

i.e., Wi/pW/mf e Ceo- Similarly, because ||w|| < ||a;i|| + ||cJ2|| + ||yp|| + ||r||, applying 
Lemma 3.3.2 we have ||cji|| < c||Mp||, ||w2|| < c\\yp\\ which together with Msl^f G £00 
imply that ||w||/to/ G £00 and the lemma is proved. In (i) to (iii), (5 > is chosen 
so that ^^jjT, Wm{s),W{s) are analytic in Re[s] > 6/2. D 



6.8.2 Proof of Theorem 6.5.1: Direct MRAC 

In this section we present all the details of the proof in the five steps outlined in 
Section 6.5.3. 

Step 1. Express the plant input and output in terms of the adaptation error 
0^ LU. From Figure 6.14, we can verify that the transfer function between the input 
r H — ^6^ uj and the plant output yp is given by 



yp = GM{r+ye^oj\ 



where 



Gc{s) 



(1 _ ei^{sl - F)-^g)Rp - kpZp[e*^^{sI - F)-^g + 0*] 



Using (6.3.12), (6.3.13), and [sI—F) ^g=jrf\j we have, after cancellation of 
all the stable common zeros and poles in Gc{s), that Gc{s) = Wm{s). Therefore, 
the plant output may be written as 

Vp = Wm{s) (r + ^^'^'^ j (6.8.2) 

Because yp = Gp{s)up and Gp^{s) has stable poles, we have 

Up = G-\s)W„,{s) (r + ^0'^^^ (6.8.3) 

where G~^{s)Wm{s) is stable (due to assumption PI) and biproper (due to assump- 
tion M2). For simplicity, let us denote the £25-norm ||(-)t||25 for some (5 > by 

II • II . Using the fictitious normalizing signal nA = 1 + ||up|P + ||2/p|P, it follows from 
(6.8.2), (6.8.3) and Lemma 3.3.2 that 

m)<c+c\\e'^ujf (6.8.4) 
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holds for some 5 > such that Wm{s—5/2)Gp^{s — S/2) is a stable transfer function, 
where c > in (6.8.4) and in the remainder of this section denotes any finite 
constant. The normalizing properties ofnif have been established in Section 6.8.1, 
i.e., all signals in the closed- loop adaptive system and some of their derivatives are 
bounded from above by nif provided 6 G Coo- 

Step 2. Use the swapping lemmas and properties of the C2S norm, to hound 
\\0^ ijj\\ from, above with terms that are guaranteed by the adaptive law to have finite 
C2 gains. Using the Swapping Lemma A. 2 in Appendix A, we can express 9^ to as 

(roj = Fi{s,aa)ie uj + 9^ i:u\ + F [s , a^) ((T uj\ (6.8.5) 

where _F(s,ao) = , "" ■,„. , -Fi(s, Qo) = ^ — , ao > is an arbitrary con- 

stant and n* is the relative degree of Wm{s). On the other hand, using Swapping 
Lemma A.l, we can write 

(Tuj = W^^{s) {¥W{s)uj + Wc{s){{Wb{s)uj'^)e)\ (6.8.6) 

where M^(s) is a strictly proper transfer function with poles and zeros in C~ that 
we will specify later. Using (6.8.6) in (6.8.5) we obtain 

e^uj = Fi[e uj + e^t:o] + Fw-^[e'^w{3)uo + Wc{{WbUj'^)e)] (6.8.7) 

where F{s)W^^{s) can be made proper by choosing lK(s) appropriately. 

We obtain a bound for ||0^cc;|| by considering each adaptive law separately. 

Adaptive Law of Table 6.5. We express the normalized estimation error as 
e = WmL{p*F^ -Pi- enl) 



F* = F.-.. = !,„,;..-.. + « + .„;, ,6.8.8, 

Choosing W{s) = L^^{s) and substituting for 6^W{s)ijj = 9'^L~^{s)uj from (6.8.8) 
into (6.8.7), we obtain 



-T _ 1 

9'^Lu = Fi{0 Lu + e'^u)+ —FW^^e + FL 

P* 



~ 2 



Now from the definition of ^ and using Swapping Lemma A.l with W{s) 
L''^{s), we have ^ = Uf — 9^ (j) = L^^Up — 0'^<f), i.e., 

i = -e^cf, + L-^e^oj = Wc[{WbUj'^)e] 
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Therefore, 

-T _ 1 1 

0'^uj = Fi[d Lu + e'^i:j] + —FW.;;,h+ —FL[pWc{WbUj'^)e+en'^] (6.8.9) 

p* p* 

From the definition of F{s), -Fi(s) and Swapping Lemma A. 2, it follows that for 
ao > S 

\\Fi{s)\\^s < —, \\F{s)W-\s)\\^s < caf 
Therefore, 

llFo-ll < ^{\\fco\\ + WFcoW) + cafm + M + WenlW) (6.8.10) 

where uj = pWc{s)[Qb{t)9],Qi, = Wb{s)LLj'^ . Using Lemma 3.3.2, we can show that 
Qh/fTif e Ceo and, therefore, 

ll^ll < c\\6mf\\ (6.8.11) 

Using the normalizing properties of mf established in Lemma 6.8.1, we have 

ll^'^c^ll < cprnfl WFCoW < cWCoW < cruf, \\enl\\ < c\\en,mf\\ 
It, therefore, follows from (6.8.10), (6.8.11) that 

llFc.ll < -WenifW + -mf + caf{\\e\\ + ||^m/|| + ||6n,m/||) (6.8.12) 

ao ao 

which we express as 

\\e'^Lo\\ < cafWgmfW + —nif (6.8.13) 

where g'^ = e^nl + e^ + |^p, by taking ao > 1 so that — < ag and using ||e|| < 
||emy II due to nif > 1. Since en^, e, G C2, it follows that g G £2- 

Adaptive Laws of Table 6.6. The normalized estimation error is given by 

^_ Wm{s)Up-Z _ 9'^<f>p 2_,T, 

l + n2 " l + nr ^'^P^" 
where (pp = [Wm{s)ujJ ,Wm{s)ujJ ,Wm{s)yp,yp]^ ■ Let 

ujp= [ujJ,ujJ,yp,W^^yp]'^ 
then (pp = Wm(s)(jjp. To relate d'^oj with e, we write 

9 uj = 9q uJo + Cor 
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where luq = [lu-I , LU2 , Up] and 60 = [O-l ,62 ,0^] . From 

yp = Wm{r+—e'^uj) 
Co 



we have r = W^^yp ^O'^ui, therefore, 

Fij = e^ujo + coW-^[yp] - ^Fco = e'^ijp - '^¥uj 

i-e., 

(Tuj = ^0'^LUp (6.8.14) 

Co 

Using (j)p = Wm(s)(jjp and applying Swapping Lemma A.l we have 

Wm{s)e'^^p = e'^<t>p + Wc{WbiJ^)9 

From Swapping Lemma A. 2, we have 

e'^ujp = Fi{0 LUp + 9'^ujp) + F{e'^ujp) 

where Fi{s),F{s) satisfy \\Fi{.s)\\^s\\ < ^, \\F{s)W^\s)\\^s < caf for «„ > 6. 
Using the above two inequalities, we obtain 

e'^LUp = Fiie'^up + 0'^LUp) + Fw-'[e'^cj)p + w,{WbiuJ)e] (6.8.15) 



Using (6.8.14) we obtain 



5^ I ^T • Co -J- Co ^^ Co -J- . 

1 iOp + 6 UOp = —0 UJ -\ — -0 UJ -\ — -0 LO 

Cq Cq Cq 



which we use together with (j)p = —e — en^ to express (6.8.15) as 
e^LUp = Fi ('^0'^LO + ^^0^ u + '^0'^Lj]+FW;;,^[-e-enl + Wc{WbLU^)0] (6.8.16) 

\C0 Cq Cq / 

Due to the boundedness of — , it follows from (6.8.14) that 

We'^LoW < c\\0'^ujp\\ (6.8.17) 

Using the same arguments as we used in establishing (6.8.13) for the adaptive laws 
of Table 6.5, we use (6.8.16), (6.8.17) and the normalizing properties oinrif to obtain 

\\¥lo\\ < c\\¥ujp\\ < ca^'WgmfW + —ruf (6.8.18) 

ao 
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where g £ £2- 

Step 3. Use the B-G Lemma to establish signal boundedness. Using (6.8.13) or 
(6.8.18) mmj <c + c||^^a)||2, we have 

mj<c + cal'^'\\gmff+-^mj (6.8.19) 

which for large ao implies 

m} <c + cal"'\\gmf\\^ 

for some other constant c > 0. The boundedness of mf follows from g £ C2 and 
the B-G Lemma. 

Because mf,d G £00, it follows from Lemma 6.8.1 that Up,yp,LU e C^o and 
therefore all signals in the closed-loop plant are bounded. 

Step 4. Establish convergence of the tracking error to zero. Let us now consider 
the equation for the tracking error that relates ei with signals that are guaranteed 
by the adaptive law to be in £2- For the adaptive law of Table 6.5(A), we have 

ei = e + W^Lenl + W^Lp^ 

Because ^ = L~^O^uj — 0^4) = Wc{WbUJ^)9, e, trig, 9 € £2 and uj,ns e Coo, it 
follows that ei G £2- In addition we can establish, using (6.8.2), that ei G Coc and 
therefore from Lemma 3.2.5, we conclude that ei{t) — > as i ^ c». 

For the adaptive laws of Table 6.5(B,C) the proof follows by using L{s) = W^\s) 
and following exactly the same arguments as above. For the adaptive laws of Ta- 
ble 6.6 we have 



em 



2 



Wn^e'^Lu - e^c 



Applying Swapping Lemma A.l, we have 

w^e^uj = e^WraOJ + Wc{WbUJ^)e 

i.e., 

em^ = e'^[W^uj - (f)p] + Wc{WbUJ^)e 

Now, Wm^ — 'Pp = [0, • . • , 0, — ei]^, hence, 

coei = -em^ + Wc{WhLu'^)e 

Because —,m,ui are bounded and em, 9 G £2, it follows that ei G £2- As before we 
can use the boundedness of the signals to show that ei G C^o which together with 
ei G L2 imply that ei(i) ^ as i ^ 00. 
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Step 5. Establish parameter convergence. First, we show that 0, (j)p are PE if 
r is sufficiently rich of order 2n. From the definition of (j), we can write 



4> = H{.s) 



{sI-F)-^gUp 
{si - F)-^gyp 

Vp 
r 



where H{s) = Wm{s) if the adaptive law of Table 6.5(B) is used and H{s) = L^^{s) 
if that of Table 6.5(A) is used. Using Up = Gp^{s)yp and yp = Wm{s)r + Ci, we 
have 

= 0m + 



where 



(j)^ = H{s) 



{sI-F)-^gGp\s)W^{s) 

{sI-F)'^gWUs) 

Wm{s) 

1 



r, (f) = H{s) 



{sI-F)-'gG„'{s) 

{sI-F)-^g 

1 





ei 



Because ei G C2, it follows from the properties of the PE signals that (j) is PE if 
and only if (/»,„ is PE. In the proof of Theorem 6.4.1 and 6.4.2, we have proved that 

- {.sI-F)-^gG-\s)Wm{s) ' 
A {sI-F)-^gW^{s) 

W^{s) 
1 

is PE provided r is sufficiently rich of order 2n. Because H{s) is stable and minimum 
phase and 0o G £00 owing to r G £00, it follows from Lemma 4.8.3 (iv) that 
</.„ = 7J(s)0o is PE. 

From the definition of <f)p, we have 



<i>p = Wm{s] 



{sI-F)-^gG7p^{s)WUs) 

{sI-Fr^gW^{s) 

W^s) 

1 



W^{s){sI-F)-^gG-\s) 

Wra{s){sl - Pyhj 

Wm{s) 

1 



ei 



Because (j)p has the same form as (j), the PE property of (f)p follows by using the 
same arguments. 

We establish the convergence of the parameter error and tracking error to zero 
as follows: First, let us consider the adaptive laws of Table 6.5. For the adaptive 
law based on the SPR-Lyapunov approach (Table 6.5(A)), we have 



-Te(t)sgn{kp/k„i) 



(6.8.20) 
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where Cj{sl - A^y^Bc = W„i{s)L{s) is SPR. The stabihty properties of (6.8.20) 
are estabhshed by Theorem 4.5.1 in Chapter 4. According to Theorem 4.5.1 (iii), 
9{t) — > as i — > oo provided (/>,(/) G £00, 4> is PE and ^ G £2- Because ^ = 
Wc{W}jijJ^)0 and to G £00, S G £2, we have ^ G £2- From Up,yp G £00 and the 
expression for (/), we can estabhsh that 4>,(j) £ Coo- Because (j) is shown to be PE, 
the convergence of 9{t) to zero follows. From 9{t) ^ as f ^ c» and p^, en^ G C2 
and the stability of Ac, we have that e(i) — > as i ^ c». In fact, the convergence 
of e(i) to zero follows from the properties of the Lyapunov-like function used to 
analyze (6.8.20) in Theorem 4.5.1 without requiring (j) to be PE. 

The proof for the adaptive law of Table 6.5(B) follows from the above arguments 
by replacing L~^(s) with Wm{s) and using the results of Theorem 4.5.2 (iii). 

For the adaptive laws of Table 6.6, we have established in Chapter 4 that without 
projection, 6{t) — > as t — > (X) exponentially fast provided (pp is PE. Since projection 
can only make the derivative V of the Lyapunov-like function V , used to analyze the 
stability properties of the adaptive law, more negative the exponential convergence 
of 6 to zero can be established by following exactly the same steps as in the case of 
no projection. 

6.8.3 Proof of Theorem 6.6.2: Indirect MRAC 

We follow the same steps as in proving stability for the direct MRAC scheme: 

Step 1. Express yp, Up in terms of d^oj. Because the control law for the indirect 
MRAC is the same as the direct MRAC scheme, equations (6.8.2), (6.8.3) still hold, 
i.e., we have 

yp = W^{s) (r + ^0^^] , Up = G;\s)W„,{s) (r + ^0^^) 
As in the direct case, we define the fictitious normalizing signal 

mj^l + Wupr+Wypf 

where || • || denotes the >C2<5-norm for some (5 > 0. Using the same arguments as in 
the proof of Theorem 6.5.1, we have 

mj < c+c\\d'^ujf 

Step 2. We upper bound WO'^ojW with terms that are guaranteed by the adaptive 
laws to have C2 gains. From (6.6.25), we have 

ejan^2{s) = A(s) - ilp(s, t) ■ Q{s, t) (6.8.21) 

Kp 
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9jan^2{s) + esAis) = ^{Q{s,t) ■ Rp{s,t) - Ao{s)Rm{s)] (6.8.22) 

kp 

Consider the above polynomial equations as operator equations. We apply (6.8.21) 
^up, and (6.8.22) to ^ 



to the signal —fr^Up, and (6.8.22) to —^r^Vp to obtain 



eJW,n{s)uJi = W„i{s)up - —Zp{s,t) ■ Q{s,t) " ^ Up 

kp ^^s) 

eJWm{s)iU2 + e3Wm{s)yp = i [Q(s, i) • i?p(s, i) - Ao (s)i?™(s)] ^^^p 



Combining these two equations, we have 



9t[W„(s)cjo = Wm{s)up - j-Zp{s, t) ■ Q{s, t) "' ^ Up 






+ ^[Q{s,t) ■ Rp{.s,t) - Ao{.s)Rrr,{.s)]^^^^yp (6.8.23) 
kp A(sj 

where ^o = [(^J , (^J t ^3]^ j "^o = ['^J , ^2 j Vpl^ ■ Repeating the same algebraic manip- 
ulation, but replacing 9, Op by 6* , 9* in the polynomial equations, we have 

01 Wm(.s)uJO = W.n,{s)Up .\ Mp 

Q{.s)Rp{s) - A^{s)R,^{.s)WUs) 
+ kp A{s) ^^ ^ ' 

where Q{s) is the quotient of AQ{s)R„i{s) / Rp{s) whose order is n* — 1 and n* is 
the relative degree of Gp{s). Subtracting (6.8.24) from (6.8.23), we have 

~eJWra{s)oj^ = \-^Zp{s,t) ■ Q{s,t)^^Up+^Q{s,t) ■ Rp{s,t)^^yp\ 
y kp '■^{S) kp '■^{3} J 

/ 1 Aa{s)Rra{s) ^^^ . , 1 Ao(s)i?„(.s) 1 

{kp A(s) "^ kp A{s) '^J 

kpA{s) ^"^^'^""^ - ^rK(^^rn{s)yp 

6/ - ei/ + 62/ (6.8.25) 



A 



where 9q = 9q — 9q and 



e/ = -^Zp[s,t) ■Q(s,t)———Up+ -^Q[s,t) ■Rp[s,t)———yp 
kp '■^{Sj kp '■^{s) 
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61/162/ are defined as the terms in the second and third brackets of (6.8.25), re- 
spectively. Because cq = -f^,CQ = -^— , A(s) = Ao{s)Zm{s) and Zp{s)up = Rp{s)yp, 
we have 

ei/ = (co - CQ)yp, 62/ = (6.8.26) 

Using (6.8.26) in (6.8.25) and defining ujp = [ujj ,W~^^{s)yp]^ we can write 

e'^Wm{s)ujp = e/ (6.8.27) 

Because O'^iu = '^O^ujp, proved in Section 6.8.2 (see equation (6.8.14) ), we use 
Swapping Lemma A. 2 to write 

e'^u) = ^ (Fi{s, ao){e'^ujp + Fojp) + F{s, aoW'^ujp) (6.8.28) 

Co V ^ 

where F{s,ao) and Fi{s,aQ) are as defined in Section 6.8.2 and satisfy 

\\Fi{s, ao)\U5 < —, \\F{s,ao)W~\s)\Us < ca^ 
ao 

for any ao > (5 > 0. Applying Swapping Lemma A.l to Wm[s)9^ tOp and using 
(6.8.27), we obtain 

'e'^ujp = w;;,\s)(e'^Wm{s)ujp + w,{s){Wb{s)ujl)e 

= W-\s)(ef + WMiWi,{s)u4)e) (6.8.29) 

Substituting (6.8.29) in (6.8.28), we have 
^T^ ^ £0 (p^^^^ ao){FLUp + ¥^p) + F{s, aa)W~\s) Uj + W,{s){Wk{s)ujl)e) 

Cq 

Because cq is bounded from below, i.e., |co| >Cq> 0, it follows from Lemma 3.3.2 
that 

ll^-T^II < ^ (pojpW + \\Fd,p\\) + caf{\\ef\\ + ||a.^l)) (6.8.30) 

where u) = Wb{L^p)^ ■ From 6 G £00 and the normalizing properties of ruf, we have 

||Fa;|| < ^prufW + -mf + ca^' {\\ej\\ + ||^m/||) (6.8.31) 

"0 "0 

We now concentrate on the term ||e/|| in (6.8.31). Let us denote 

(5(s, <) = g^a„._i(s), Zp{s,t) = b^ara{s), Rp{s,t) = s"" + ajan-i{s) 
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where bp = [kp,pj]^ , hp = p2 and pi,P2 are defined in Table 6.9. Treating s as the 
differentiation operator, using Aj,(s) = A(s)(s + Aq) and Swapping Lemma A. 3 (i), 
we have 



T-Zp{s,t) ■Q(s,t}———Up = ■^Q{s,t) ■ Zp{s,t) — — Up 

kp A^sj h '■^p{s) 



^\Qi.s,t)^Zpis,t) ^^^^^ u, 



(6.8.32) 



-q^D„._2{s) 



an'-2(s) a„(s)- 



Ap(s) 
(by taking A{s, t) = Q{s, t),B{s, t) = Zp{s, t)J= ^^Up) 

^Q{s,t) ■ Rp{s,t)^^^yp 
kp '■^{s} 

= ^\Q[s.t)[Rp[s,t) ^^^^^ yp 



and 



(6.8.33) 



-g^Z?„._2(s) 



a„._2(s) a„_i(s) 



, Wm {s){s + Ao) 
Ap(s) 

yy,,. (s) 



-Vp 



(by taking A{s,t) = Q{s,t), B{s,t) = Rp{s,t)J = ^^Vp). Using (6.8.32), 
(6.8.33) in the expression for Cf and noting that 

Rp{s,t) —-7 yp- Zp{s,t) — — Up = -Op VF™(.s)(s + Ao)0 



we have 



e/ = ^ ^-eJW,n{s){s + Xo)<p + e^} 

Kp 

where 0p, (j) are as defined in Table 6.9 and 

Cf = q^ Dn'-2{s)[an>-2{s) 



(6.8.34) 



-T, ,W„(s)(s + Ao) 

"mi's) ^-^. Ur. 



kp{s) 



-al-i(s) 



Wrn{s){s + Xo) 



kp{s) 



-Vp 



(6.8.35) 



1 aT. 



Using the normalizing properties of nif and the fact that yp = Wm{s){r + -^0 ' uj} 
and 9 G £00, we have 

l|e/|| < cW^P^fW 



Applying Swapping Lemma A.l and using 6^ <f) = —em , we can write 
OpWrr,{s){s + Ao)0 = -Wmis)is + Xo)em^ - Wc[Wb4>'^]ep 



(6.8.36) 
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Again using the normalizing properties ofnif, it follows from (6.8.34), (6.8.36) that 

||e/||<c(||emm/|| + ||^pm/||) (6.8.37) 

for some constant c. Combining (6.8.31), (6.8.37), we have 

II^T^II < ^^^.+ ^||()^^|| + ca[j'||^m/||+ca^*(||emm/|| + ||^pm/||) (6.8.38) 

From (6.6.25), we can establish, using 9p G >Coo, j- G ^oo,()p G ^2, that 6 G Coo 
and 6 & £2- Hence, 

||^T^||< ±m^ + c\\gmf\\ 

where g2= J^j^p + ck^«* (|^|2 _^ ^2^2 _^ |^ 12-) and 5 G £2- 

Step 3. Use the B-G Lemma to establish boundedness. This step is identical 
to Step 3 in the proof of stability for the direct MRAC scheme and is omitted. 

Step 4. Convergence of the tracking error to zero. From 

Vj> = WUs){r+^Fuj) 
Co 

and 6^ Lo = —O^LOn. we have 

Co P' 

ei = ^W^{s)Fuj=W,n{s)-F^p 
Cq Co 

= -Wm{s)~6'^u:p-W,{s)({Wi{s)Fu;j,)'^ (6.8.39) 

Co V Cg / 

where the last equality is obtained by applying the Swapping Lemma A.l. Substi- 
tuting 9luj from (6.8.29) in (6.8.39), we have 

ei = - (e/ + W,{s){Wi{s)ujl)e) - W,{s) ({Wb{s)~e'^ ujp)''^\ 

Co V / \ Cg/ 

Note from (6.8.35) and ap,hp e L2, Up,yp G £00 that e', G £2- From em, Op G £2 
and the boundedness of j-,m and (f), it also follows from (6.8.34), (6.8.37) that 

Cf G £2- From e/,0,co G £2, it follows that ei G £2 which together with ei G £00 
imply that ei(i) ^ as t ^ (X). □ 
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6.9 Problems 

6.1 Consider the first order plant 

b 

y = 7" 

s — 1 

where 6 > is the only unknown parameter. Design and analyze a direct 

MRAC scheme that can stabilize the plant and force y to follow the output 

ym of the reference model 

2 

^ s + 2 

for any bounded and continuous reference signal r. 

6.2 The dynamics of a throttle to speed subsystem of a vehicle may be represented 

by the first-order system 

b 

V = e + d 

s + a 
where V is the vehicle speed, 9 is the throttle angle and d is a constant load 
disturbance. The parameters 6 > 0, a are unknown constants whose values 
depend on the operating state of the vehicle that is defined by the gear state, 
steady-state velocity, drag, etc. We would like to design a cruise control 
system by choosing the throttle angle 6 so that V follows a desired velocity 
Vm generated by the reference model 

Vm = ^^K 
s + 0.5 

where Vg is the desired velocity set by the driver. 

(a) Assume that a, b, and d are known exactly. Design an MRC law that 

meets the control objective. 

(b) Design and analyze a direct MRAC scheme to be used in the case of a, b, 

and d (with 6 > 0) being unknown. 

(c) Simulate your scheme in (b) by assuming Vs = 35 and using the following 

values for a, 6, and d: (i) a = 0.02,6 = 1.3, d = 10; (ii) a = 0.02(2 + 
sin0.01i),6= 1.3, d= 10sin0.02t. 

6.3 Consider the adaptive tracking problem discussed in Section 6.2.2, i.e., the 

output y of the plant 

X = ax + bu 
y = x 

is required to track the output ym of the reference model 

where a and b are unknown constants with 6 7^ and sign(6) unknown. Design 
an adaptive controller to meet the control objective. 
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6.4 Consider the following plant 

X = —X + bu 

where 6 7^ is unknown. Design an adaptive controller that will force x to 
track Xm, the state of the reference model 

for any bounded reference input r. 

6.5 Consider the following SISO plant 

_ J, ^p(^) 

where kp, Zp{s), and Rp{s) are known. Design an MRC scheme for i/p to track 
j/m generated by the reference model 

_ , Zm{s) 
Rni{sj 

where Rm{s) has the same degree as Rp{s). Examine stability when Zp{s) is 
Hurwitz and when it is not. Comment on your results. 

6.6 Consider the third order plant 

kp{s + bo) 



Vp 



s3 + fljs^ + ais + flo ^ 



where a^, i = 0, 1, 2; 69, kp are constants and 60 > 0. The transfer function of 
the reference model is given by 

1 

y-n 



(S+1)2 

(a) Assuming that Oj, 601 ^-^id kp are known, design an MRC law that guar- 

antees closed-loop stability and tjp — > Hm as i — > 00 for any bounded 
reference input r. 

(b) Repeat (a) when ai,bo, and kp are unknown and kp > 0. 

(c) If in (b) 02 = 0,ai = 0, ao = 1 are known but kp,b() are unknown, 

indicate the simplification that results in the control law. 

6.7 Show that the MRC law given by (6.3.29) in Remark 6.3.6 meets the MRC 

objective for the plant given by (6.3.1). 

6.8 Show that the MRC law given by (6.3.27) or (6.3.28) in Remark 6.3.5 meets the 

MRC objective for the plant (6.3.1) for any given nonzero initial conditions. 



6.9. PROBLEMS 431 



6.9 Repeat the proof of Theorem 6.4.2 by using a minimal state space representa- 
tion of the error system ei = Wm{s) (s + po) p*9^ (j) as explained in Remark 
6.4.5. 



6.10 Consider the third-order plant 



Vp 



s^ -\- a2S^ + ais + flo 



Ur, 



where ai,i = 0,1,2 are unknown constants and the reference model 

2 

^"~ (s+l)(s + 2)(s + 2.5)'' 

(a) Design a direct MRAC law with unnormalized adaptive law so that all 

signals in the closed-loop plant are bounded and yp{t) — > ym{t) as i — > cxd 
for any bounded reference input r. 

(b) Simulate your scheme by assuming the following values for the plant 

parameters 

ttg = 1, ai = —1.5, 02 = 

and examine the effect of your choice of r on parameter convergence. 

6.11 Design and analyze a direct MRAC with normalized adaptive law for the 

plant 

b 

Vp — ; ^p 
s -\- a 

where h > 0.5, a are unknown constants. The reference model is given by 

3 

Vr, 



(a) Design a direct MRAC scheme based on the gradient algorithm 

(b) Repeat (a) for a least-squares algorithm 

(c) Repeat (a) using the SPR-Lyapunov design approach with normalization 

(d) Simulate your design in (c) with and without normalization. For simu- 

lations use h = 1.2, a = —1 and r a signal of your choice. 

6.12 Repeat Problem 6.11(a), for a hybrid MRAC scheme. Simulate your scheme 
using the values of 6= 1.2,o= —1 and r a signal of your choice. 

6.13 Consider the plant 

_ [s + hg) 

{s + ay 
where 6o > 0.2 and a are unknown constants. The reference model is given 

by 

1 

2/m = ——r'T 
s+l 
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(a) Design a direct MRAC scheme with unnormalized adaptive law 

(b) Repeat (a) with a normalized adaptive law 

(c) Design an indirect MRAC scheme with an unnormalized adaptive law 

(d) Repeat (c) with a normalized adaptive law 

(e) Simulate one direct and one indirect MRAC scheme of your choice from 

(a) to (d) and compare their performance when 60 = 2, a = —5, a nd 
r = 2 + sinO.St. Comment. 

6.14 Consider the control law (6.3.27) for the plant (6.3.1) where 6*,i = 1,2,3,Cq 
are the desired controller parameters. Design and analyze a direct MRAC 
scheme based on this control law. 

6.15 Consider the control law given by equation (6.3.29) in Remark 6.3.6 designed 
for the plant (6.3.1). Design and analyze a direct MRAC scheme based on 
this control law. 



6.16 Consider the SISO plant 






where Zp{s), Rp{s) are monic, Zp{s) is Hurwitz and the relative degree 
n* = I. The order n of Rp is unknown. Show that the adaptive control law 



2 



Up = - 9ypSgn{kp), 6 = y. 

guarantees signal boundedness and convergence of j/p to zero for any finite n. 
(Hint: The plant may be represented as 

xi = Aiixi + Ai2yp, xieTZ"~'^ 
yp = ^21X1 + floyp + kpUp 

where An is stable.) 

6.17 Following the same procedure used in Section 6.6.2, derive an indirect MRAC 
scheme using unnormalized adaptive laws for a plant with n* = 2. 

6.18 Let uj e Coo be PE and e G S{^) {^C^o where /i > 0. Let uj^ = uj + e. Show 
that there exists a /i* > such that for any ^ G [0,/i*), uj^ is PE. 

6.19 Consider the MRAC problem of Section 6.4.1. It has been shown (see Remark 
6.4.3) that the nonzero initial condition appears in the error equation as 

ei = Wm{s)p*{up - r^w) + C7(s/- Ae)-ie(O) 
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Show that the same stability results as in the case of e(0) = can be estab- 
lished when e(0) 7^ by using the new Lyapunov-like function 

V = -^ + -^^— \p* I + pe^Poeo 
where sq is the zero-input response, i.e., 

eo = AcCq, eo(0) = e(0) 

Pq satisfies Aj Pq + PqAc = —I and /3 > is an arbitrary positive constant. 



Chapter 7 

Adaptive Pole Placement 
Control 

7.1 Introduction 

In Chapter 6 we considered the design of a wide class of MRAC schemes for 
LTI plants with stable zeros. The assumption that the plant is minimum 
phase, i.e., it has stable zeros, is rather restrictive in many applications. For 
example, the approximation of time delays often encountered in chemical 
and other industrial processes leads to plant models with unstable zeros. As 
we discussed in Chapter 6, the minimum phase assumption is a consequence 
of the MRC objective that requires cancellation of the plant zeros in an 
effort to make the closed-loop plant transfer function equal to that of the 
reference model. The same assumption is also used to express the desired 
controller parameters in the form of a linear or bilinear parametric model, 
and is, therefore, crucial for parameter estimation and the stability of the 
overall adaptive control scheme. 

Another class of control schemes that is popular in the known parameter 
case are those that change the poles of the plant and do not involve plant 
zero-pole cancellations. These schemes are referred to as pole placement 
schemes and are applicable to both minimum and nonminimum phase LTI 
plants. The combination of a pole placement control law with a parameter 
estimator or an adaptive law leads to an adaptive pole placement control 
(APPC) scheme that can be used to control a wide class of LTI plants with 

434 
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unknown parameters. 

As in the MRAC case, the APPC schemes may be divided into two 
classes: The indirect APPC schemes where the adaptive law generates on- 
line estimates of the coefficients of the plant transfer function that are then 
used to calculate the parameters of the pole placement control law by solving 
a certain algebraic equation; and the direct APPC where the parameters of 
the pole placement control law are generated directly by an adaptive law 
without any intermediate calculations that involve estimates of the plant 
parameters. 

The direct APPC schemes are restricted to scalar plants and to spe- 
cial classes of plants where the desired parameters of the pole placement 
controller can be expressed in the form of the linear or bilinear parametric 
models. Efforts to develop direct APPC schemes for a general class of LTI 
plants led to APPC schemes where both the controller and plant parameters 
are estimated on-line simultaneously [49, 112], leading to a rather complex 
adaptive control scheme. 

The indirect APPC schemes, on the other hand, are easy to design and 
are applicable to a wide class of LTI plants that are not required to be 
minimum phase or stable. The main drawback of indirect APPC is the 
possible loss of stabilizability of the estimated plant based on which the 
calculation of the controller parameters is performed. This drawback can 
be eliminated by modifying the indirect APPC schemes at the expense of 
adding more complexity. Because of its flexibility in choosing the controller 
design methodology (state feedback, compensator design, linear quadratic, 
etc.) and adaptive law (least squares, gradient, or SPR-Lyapunov type), 
indirect APPC is the most general class of adaptive control schemes. This 
class also includes indirect MRAC as a special case where some of the poles 
of the plant are assigned to be equal to the zeros of the plant to facilitate 
the required zero-pole cancellation for transfer function matching. Indirect 
APPC schemes have also been known as self-tuning regulators in the litera- 
ture of adaptive control to distinguish them from direct MRAC schemes. 

The chapter is organized as follows: In Section 7.2 we use several ex- 
amples to illustrate the design and analysis of APPC. These examples are 
used to motivate the more complicated designs in the general case treated in 
the rest of the chapter. In Section 7.3, we define the pole placement control 
(PPC) problem for a general class of SISO, LTI plants and solve it for the 
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case of known plant parameters using several different control laws. The 
significance of Section 7.3 is that it provides several pole placement control 
laws to be used together with adaptive laws to form APPC schemes. The 
design and analysis of indirect APPC schemes for a general class of SISO, 
LTI plants is presented in Section 7.4. Section 7.5 is devoted to the design 
and analysis of hybrid APPC schemes where the estimated plant parameters 
are updated at distinct points in time. The problem of stabilizability of the 
estimated plant model at each instant of time is treated in Section 7.6. A 
simple example is first used to illustrate the possible loss of stabilizability 
and a modified indirect APPC scheme is then proposed and analyzed. The 
modified scheme is guaranteed to meet the control objective and is therefore 
not affected by the possible loss of stabilizability during parameter estima- 
tion. Section 7.7 is devoted to stability proofs of the various theorems given 
in previous sections. 

7.2 Simple APPC Schemes 

In this section we use several examples to illustrate the design and analysis of 
simple APPC schemes. The important features and characteristics of these 
schemes are used to motivate and understand the more complicated ones to 
be introduced in the sections to follow. 

7.2.1 Scalar Example: Adaptive Regulation 

Consider the scalar plant 

y = ay + bu (7.2.1) 

where a and b are unknown constants, and the sign of b is known. The control 
objective is to choose u so that the closed- loop pole is placed at —am, where 
am > is a given constant, y and u are bounded, and y(t) converges to zero 
as t ^ oo. 

If a and b were known and 6/0 then the control law 

u=-ky + r (7.2.2) 

k = ^^ (7.2.3) 
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where r is a reference input, would lead to the closed-loop plant 

y = -an^y + br (7.2.4) 

i.e., the control law described by (7.2.2) and (7.2.3) changes the pole of the 
plant from a to —am but preserves the zero structure. This is in contrast to 
MRC, where the zeros of the plant are canceled and replaced with new ones. 
It is clear from (7.2.4) that the pole placement law (7.2.2) and (7.2.3) with 
r=0 meets the control objective exactly. 

Let us now consider the case where a and h are unknown. As in the 
MRAC case, we use the certainty equivalence approach to form adaptive 
pole placement control schemes as follows: We use the same control law as 
in (7.2.2) but replace the unknown controller parameter k with its on-line 
estimate k. The estimate k may be generated in two different ways: The 
direct one where k is generated by an adaptive law and the indirect one 
where k is calculated from 

k = ^4^ (7.2.5) 

b 

provided 5/0 where a and b are the on-line estimates of a and b, respec- 
tively. We consider each design approach separately. 

Direct Adaptive Regulation In this case the time-varying gain k in the 
control law 

u = —ky + r, r = (7.2.6) 

is updated directly by an adaptive law. The adaptive law is developed as 
follows: We add and subtract the desired control input, u* = —ky + r with 
k = ^i^ in the plant equation, i.e., 

y = ay + bu* — bu* + bu = —amy — b(k — k)y + br 

to obtain, for r = 0, the error equation 

y = -amy - bky (7.2.7) 

where k = k — k, that relates the parameter error term bky and regulation 
error y through the SPR transfer function -— — . As shown in Chapter 4, 
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(7.2.7) is in the appropriate form for applying the Lyapunov design approach. 
Choosing 

V = — + ' ' 



it follows that for 



we have 



2 27 

k = 7y2sgn(6) (7.2.5 



V = -aW < 



which implies that y,k,u ^ Coo and y G £2- From (7.2.7) and y,k E Coo we 
have y £ Coo', therefore, using Lemma 3.2.5 we obtain y(t) ^ as t ^ 00. 

In summary, the direct APPC scheme in (7.2.6) and (7.2.8) guaran- 
tees signal boundedness and regulation of the plant state y(t) to zero. The 
scheme, however, does not guarantee that the closed-loop pole of the plant 
is placed at —am even asymptotically with time. To achieve such a pole 
placement result, we need to show that k -^ Qd^m as t ^ 00. For parameter 
convergence, however, y is required to be PE which is in conflict with the 
objective of regulating y to zero. The conflict between parameter identiflca- 
tion and regulation or control is well known in adaptive control and cannot 
be avoided in general. 

Indirect Adaptive Regulation In this approach, the gain k{t) in the 
control law 

u=-k{t)y + r, r = (7.2.9) 

is calculated by using the algebraic equation 

k=^±^ (7.2.10) 

h 

with 6/0 and the on-line estimates a and b of the plant parameters a and 
6, respectively. The adaptive law for generating a and b is constructed by 
using the techniques of Chapter 4 as follows: 
We construct the series-parallel model 

Vm = -amiVm - y) + ay + bu (7.2.11) 
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then subtract (7.2.11) from the plant equation (7.2.1) to obtain the error 
equation 

e = —amS — ay — bu (7.2.12) 

where e = y — ym, a = a — a, b = b — b. Using the Lyapunov-hke function 

e2 a2 12 

V = \ \ 
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for some 71 , 72 > and choosing 

a = 7iey, b = 72en (7.2.13) 

we have 

V = -ttme^ < 

which imphes that e,a,b £ £00 and e e £2- These properties, however, 
do not guarantee that 5(t) / Vt > 0, a condition that is required for k, 
given by (7.2.10), to be finite. In fact, for k to be uniformly bounded, we 
should have \b(t)\ > 69 > Vt > and some constant feo- Because such a 
condition cannot be guaranteed by the adaptive law, we modify (7.2.13) by 
assuming that \b\ > bo > where bo and sgn(5) are known a priori, and use 
the projection techniques of Chapter 4 to obtain 

h = 7iey (7.2.14) 

f _ J J2eu if |6| > 60 or if |6| = 60 and sgn(fc)en > 
1 otherwise 

where 6(0) is chosen so that 6(0)sgn(6) > 69. The modified adaptive law 
guarantees that \b{t)\ > 60 Vi > 0. Furthermore, the time derivative V of V 
along the solution of (7.2.12) and (7.2.14) satisfies 



V 



— amS if |6| > 60 or if |5| = 69 and sgn{b)eu > 

—ame^ — beu if |6| = 60 and sgn(5)en < 

Now for \b\ = 60 and sgn(b)eu < 0, since |fe| > bo, we have 

beu = beu — beu = (\b\ — \b\)eu sgn(6) = (bo — \b\)eu sgn(b) > 

therefore, 

V < —Qme 
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Hence, e,d,b e >Coo;e £ £2 and \b(t)\ > 60 Vt > 0, which imphes that 
k e £oo- Substituting for the control law (7.2.9) and (7.2.10) in (7.2.11), 
we obtain ym = —amym, which implies that ym £ ^oo,ymii) ^ as i ^ 00 
and, therefore, y,u ^ Coo- From (7.2.12), we have e e £00, which, together 
with e e C2, implies that e(t) = y(t) — ym(t) ^ as t ^ 00. Therefore, it 
follows that y{t) = e{t) + ym{i) ^ as t ^ 00. 

The indirect adaptive pole placement scheme given by (7.2.9), (7.2.10), 
and (7.2.14) has, therefore, the same stability properties as the direct one. 
It has also several differences. The main difference is that the gain k is 
updated indirectly by solving an algebraic time varying equation at each 
time t. According to (7.2.10), the control law (7.2.9) is designed to meet the 
pole placement objective for the estimated plant at each time t rather than 
the actual plant. Therefore, for such a design to be possible, the estimated 
plant has to be controllable or at least stabilizable at each time t, which 
implies that \h{t)\ / Vt > 0. In addition, for uniform signal boundedness, h 
should satisfy \h{t)\ > 60 > where 69 is a lower bound for |fc| that is known 
a priori. 

The fact that only the sign of h is needed in the direct case, whereas the 
knowledge of a lower bound 60 is also needed in the indirect case motivated 
the authors of [46] to come up with a modified indirect scheme presented in 
the next section where only the sign of b is needed. 

7.2.2 Modified Indirect Adaptive Regulation 

In the indirect case, the form of the matching equation 

a — bk = —Um 
is used to calculate k from the estimates of a, 6 by selecting k to satisfy 

a — bk = —am 

as indicated by (7.2.10). 

If instead of calculating k{t) we update it using an adaptive law driven 
by the error 

Ec = a{t) - b{t)k{t) + am 

then we end up with a modified scheme that does not require the knowledge 
of a lower bound for |6| as shown below. The error £c is motivated from the 
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fact that as Ec ^ the estimated closed- loop pole d(t) — h{t)k{t) converges 
to — ttm, the desired pole. The adaptive law for k is developed by expressing 
Ec in terms of k,d,b by using Um = bk — a and adding and subtracting the 
term bk, i.e., 

Ec = a — bk + bk — a + bk — bk = a — bk — bk 

The adaptive law for k is then obtained by using the gradient method to 
minimize -^ w.r.t. k, i.e., 

k=-,-^ = ,bEc 

where 7 > is an arbitrary constant. Because b = |6|sgn(6) and 7 is arbi- 
trary, it follows that 

k = k = 7oecSgn(&) 

for some other arbitrary constant 70 > 0. To assure stability of the overall 
scheme, the adaptive laws for o, b in (7.2.13) are modified as shown below: 

a = a = 7iey - 71 - -—- = -fiey - 71 ^c 
2 da 

i i l^^c 

= 6 = 72eu - 72-— ^ = 72eu + 72A;ec 
2 db 

The overall modified indirect scheme is summarized as follows: 



u = 


-ky 


k = 


7o£cSgn(6) 


a = 


71 ey - 71 £c 


b = 


72 eu + 72fc£c 


£c = 


a — bk + am, 


Vm = 


-amiUm - y. 



y-Vm 



stability Analysis Let us choose the Lyapunov-like function 

e2 a2 P P\b\ 

V= — + -— + -— + 



2 271 272 270 
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where e = y — ym satisfies the error equation 

e = — CmC — ay — bu (7.2.12) 

The time-derivative F of F along the trajectories of the overall system 
is given by 

V = —o-m^ — £c{o. — bk — bk) = —amG — Ec ^ 

which implies that e,a,b,k e £oo; e,ec £ ^2- The boundedness of ym and, 
therefore, of y, u is established as follows: The series-parallel model equation 
(7.2.11) can be rewritten as 

i/m = -am{ym - y) + {cL - bk)y = -{am - £c)ym + £ce 

Because e,ec E Coo 0-^2, it follows that ym £ ^oo and, therefore, y,u E Coo- 
From ec,e £ Coo and e,ec G C2, we have e(t),ec{t) -^ as t ^ cx), which 
imply that ym{t) ^ as t ^ 00. Therefore, y{t) ^ as t ^ 00. 

The modified indirect scheme demonstrates that we can achieve the same 
stability result as in the direct case by using the same a priori knowledge 
about the plant, namely, the knowledge of the sign of b. For the modified 
scheme, the controller parameter k is adjusted dynamically by using the 
error e^ between the closed-loop pole of the estimated plant, i.e., a — bk 
and the desired pole —am- The use of Cc introduces an additional gradient 
term to the adaptive law for a, b and increases the complexity of the overall 
scheme. In [46] it was shown that this method can be extended to higher 
order plants with stable zeros. 

7.2.3 Scalar Example: Adaptive Tracking 

Let us consider the same plant (7.2.1) as in Section 7.2.1, i.e., 

y = ay + bu 

The control objective is modified to include tracking and is stated as follows: 
Choose the plant input u so that the closed-loop pole is at — a^; u,y E Coo 
and y{t) tracks the reference signal ymit) = c,\/t > 0, where c / is a finite 
constant. 

Let us first consider the case where a and b are known exactly. It follows 
from (7.2.1) that the tracking error e = y — c satisfies 

e = ae + ac + bu (7.2.15) 



7.2. SIMPLE APPC SCHEMES 443 

Because a, b, and c are known, we can choose 

u=-kie-k2 (7.2.16) 

where 

a + ttrn , ac 

(provided 6 / 0) to obtain 

e = —amS- (7.2.17) 

It is clear from (7.2.17) that e(t) = y{t) — y^ -^ exponentially fast. 

Let us now consider the design of an APPC scheme to meet the control 
objective when a and b are constant but unknown. The certainty equivalence 
approach suggests the use of the same control law as in (7.2.16) but with 
ki and k2 replaced with their on-line estimates ki{t) and k2{t), respectively, 
i.e., 

u = -ki{t)e-k2it) (7.2.18) 

As in Section 7.2.1, the updating of ki and ^2 may be done directly, or 
indirectly via calculation using the on-line estimates d and b of the plant 
parameters. We consider each case separately. 

Direct Adaptive Tracking In this approach we develop an adaptive 
law that updates ki and ^2 in (7.2.18) directly without any intermediate 
calculation. By adding and subtracting the desired input u* = —kie — k2 in 
the error equation (7.2.15), we have 

e = ae + ac+ b( — kie — ^2) + b(kie + ^2) + bu 
= -ttme + b(u + kie + ^2) 

which together with (7.2.18) imply that 

e = -ame-b(kie + k2) (7.2.19) 

where ki = ki — ki, k2 = k2 — k2. As in Chapter 4, equation (7.2.19) motivates 



(7.2.20) 



Lyapunov-like fu: 


Qction 






V = 


e2 kl\b\ kl\b\ 
2 271 272 
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whose time-derivative V along the trajectory of (7.2.19) is forced to satisfy 

V = -ame'^ (7.2.21) 

by choosing 

ki = 7ie^sgn(6), k2 = 72esgn(6) (7.2.22) 

From (7.2.20) and (7.2.21) we have that e,ki,k2 £ £00 and e e £2, which, 
in turn, imply that y,u ^ Coo and e(t) ^^ as t ^ 00 by following the usual 
arguments as in Section 7.2.1. 

The APPC scheme (7.2.18), (7.2.22) may be written as 

ft 
u = — fcie — 72Sgn(fe) / e{T)dT 

Jo 

ki = 7ie2sgn(6) (7.2.23) 

indicating the proportional control action for stabilization and the integral 
action for rejecting the constant term ac in the error equation (7.2.15). We 
refer to (7.2.23) as the direct adaptive proportional plus integral (PI) con- 
troller. The same approach may be repeated when y„i is a known bounded 
signal with known y^ £ >Coo- The reader may verify that in this case, the 
adaptive control scheme 

u = -kie - k2ym - ksVm 

ki = -fie^sgn{h) (7.2.24) 

^2 = 72eymSgn(6), A:3 = 73eymSgn(6) 

where e = y — ym, guarantees that all signals in the closed- loop plant in 
(7.2.1) and (7.2.24) are bounded, and y{t) —i- ym{t) as t —i- 00. 

Indirect Adaptive Tracking In this approach, we use the same control 
law as in the direct case, i.e., 

u=-kie-k2 (7.2.25) 

but with ki , k2 calculated using the equations 

k=^-±^, k2 = t (7.2.26) 

h b 
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provided 6/0, where a and b are the on-hne estimates of the plant param- 
eters a and b, respectively. 

We generate a and b using an adaptive law as follows: We start with the 
series-parallel model 

em = -amiem - e) + a(e + c) + bu 

based on the tracking error equation (7.2.15) and define the error cq = e — em, 
which satisfies the equation 

Co = —amSo — a(e + c) — bu (7.2.27) 

The following adaptive laws can now be derived by using the same approach 
as in Section 7.2.1: 

a = 7ieo(e + c) = 7ieoy (7.2.28) 

? _ J 72eoM if |6| > 6o or if |6| = 6o and sgn(6)eon > 
1 otherwise 

where 6(0) satisfies 6(0)sgn(6) > b^. The reader may verify that the time 
derivative of the Lyapunov-like function 

p2 ^2 l2 

2 271 272 

along the trajectories of (7.2.27), (7.2.28) satisfies 

V < -Umel 

which implies eo,a,b G £oo and eo G £2- Because of (7.2.25) and (7.2.26), 
we have e™ = —amem, and, thus, Cm G £00 and emit) —> sts t —> 00. 
Therefore, we conclude that e,u and eo G £00. From eo G £2,60 G £00 
we have eo(t) ^ as t ^ cx), which implies that e(t) ^ as t ^ 00. As 
in Section 7.2.2, the assumption that a lower bound 60 for b is known can 
be relaxed by modifying the indirect scheme (7.2.25) to (7.2.28). In this 
case both ki and k2 are adjusted dynamically rather than calculated from 
(7.2.26). 

Example 7.2.1 Adaptive Cruise Control Most of today's automobiles are 
equipped with the so-called cruise control system. The cruise control system is 
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responsible for maintaining a certain vehicle speed by automatically controlling the 
throttle angle. The mass of air and fuel that goes into the combustion cylinders and 
generates the engine torque is proportional to the throttle angle. The driver sets 
the desired speed Vd manually by speeding to Vd and then switching on the cruise 
control system. The driver can also set the speed Vd by using the "accelerator" 
button to accelerate from a lower speed to Vd through the use of the cruise control 
system. Similarly, if the driver interrupts a previously set speed by using the brake, 
the "resume" button may be used to allow the cruise control system to accelerate 
to the preset desired speed. Because of the changes in the dynamics of vehicles 
that are due to mechanical wear, loads, aerodynamic drag, etc., the use of adaptive 
control seems to be attractive for this application. 

The linearized model of the throttle system with throttle angle 9 as the input 
and speed Vg as the output is of the form 

V^ = -aVs + b0 + d (7.2.29) 

where a and b are constant parameters that depend on the speed of the vehicle, 
aerodynamic drag and on the type of the vehicle and its condition. The variable d 
represents load disturbances resulting from uphill situations, drag effects, number 
of people in the vehicle, road condition, etc. The uncertainty in the values of a, b, 
and d makes adaptive control suitable for this application. 

Equation (7.2.29) is of the same form as equation (7.2.15); therefore, we can 
derive a direct adaptive PI control scheme by following the same procedure, i.e., 
the adaptive cruise control system is described by the following equations: 

e = -kiVs-h 

fci = 71^2 (7.2.30) 

^2 = l2Vs 

where Vg = Vg — Vd and Vd is the desired speed set by the driver and 7i , 72 > are 
the adaptive gains. In (7.2.30), we use the a priori knowledge of sgn(6) > which 
is available from experimental data. 

The direct adaptive cruise control scheme given by (7.2.30) is tested on an actual 
vehicle [92]. The actual response for a particular test is shown in Figure 7.1. 

The design of an indirect adaptive cruise control scheme follows in a similar 
manner by modifying the approach of Section 7.2.3 and is left as an exercise for the 
reader. V 
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7.3 PPC: Known Plant Parameters 



As we demonstrated in Sections 6.6 and 7.2, an indirect adaptive control 
scheme consists of three parts: the adaptive law that provides on-line es- 
timates for the plant parameters; the mapping between the plant and con- 
troller parameters that is used to calculate the controller parameters from 
the on-^|g^^n^|eSfgfgJ)y^j|J^^|igrga^(jJ^g eMstefflJSlSlytelii. 

The form of the control law and the mapping between plant parameter 
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estimates and controller parameters are the same as those used in the known 
plant parameter case. The purpose of this section is to develop several 
control laws that can meet the pole placement control objective when the 
plant parameters are known exactly. The form of these control laws as well 
as the mapping between the controller and plant parameters will be used 
in Section 7.4 to form indirect APPC schemes for plants with unknown 
parameters. 

7.3.1 Problem Statement 

Consider the SISO LTI plant 

yp = Gp{s)up, Gp{s) = ^ (7.3.1) 

where Gp(s) is proper and Rp{s) is a monic polynomial. The control objec- 
tive is to choose the plant input Up so that the closed-loop poles are assigned 
to those of a given monic Hurwitz polynomial A*(s). The polynomial A*(s), 
referred to as the desired closed-loop characteristic polynomial, is chosen 
based on the closed- loop performance requirements. To meet the control 
objective, we make the following assumptions about the plant: 

PI. Rp{s) is a monic polynomial whose degree n is known. 

P2. Zp(s), Rp(s) are coprime and degree(Zp) < n. 

Assumptions (PI) and (P2) allow Zp, Rp to be non-Hurwitz in contrast to the 
MRC case where Zp is required to be Hurwitz. If, however, Zp is Hurwitz, 
the MRC problem is a special case of the general pole placement problem 
defined above with A*(s) restricted to have Zp as a factor. We will explain 
the connection between the MRC and the PPC problems in Section 7.3.2. 

In general, by assigning the closed- loop poles to those of A*(s), we can 
guarantee closed- loop stability and convergence of the plant output yp to zero 
provided there is no external input. We can also extend the PPC objective 
to include tracking, where i/p is required to follow a certain class of reference 
signals i/m, by using the internal model principle discussed in Chapter 3 as 
follows: The reference signal ym £ -^oo is assumed to satisfy 

Qm{s)yn, = (7.3.2) 
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where Qmis), the internal model of ym, is a known nionic polynomial of 
degree q with nonrepeated roots on the jcj-axis and satisfies 

P3. Qmis), Zp(s) are coprime. 

For example, if yp is required to track the reference signal ym = 2 + sin(2t), 
then Qmis) = s(s^ + 4) and, therefore, according to P3, Zp(,s) should not 
have s or s^ + 4 as a factor. 

The effect of Qmis) on the tracking error ei = yp — ym is explained 
in Chapter 3 for a general feedback system and it is analyzed again in the 
sections to follow. 

In addition to assumptions PI to P3, let us also assume that the co- 
efficients of Zpis),Rpis), i.e., the plant parameters are known exactly and 
propose several control laws that meet the control objective. The knowledge 
of the plant parameters is relaxed in Section 7.4. 

7.3.2 Polynomial Approach 

We consider the control law 

Qmis)Li.s)up = -Pi.s)yp + Mis)ym (7.3.3) 

where P(s), L(s), M(s) are polynomials (with Lis) monic) of degree q + n — 
1, n — 1, g + n — 1, respectively, to be found and Qmis) satisfies (7.3.2) and 
assumption P3. 

Applying (7.3.3) to the plant (7.3.1), we obtain the closed-loop plant 

equation 

ZpM 

LQmRp + PZp 

whose characteristic equation 

LQmRp + PZp = (7.3.5) 

has order 2n + q — 1. The objective now is to choose P, L such that 

LQmRp + PZp = A* (7.3.6) 

is satisfied for a given monic Hurwitz polynomial A* is) of degree 2n + q — 1. 
Because assumptions P2 and P3 guarantee that QmRp, Zp are coprime, it 
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follows from Theorem 2.3.1 that L, P satisfying (7.3.6) exist and are unique. 
The solution for the coefficients of L{s),P{s) of equation (7.3.6) may be 
obtained by solving the algebraic equation 

SiPi = al (7.3.7) 

where 5; is the Sylvester matrix of QmRpi Zp of dimension 2(n + q) x 2(n + q) 

Pi = [l^,p''V,a'^ = [0^_^,l,a*^]^ 

g 

Q 
I = [ln-2,ln-3, ■ ■ ■ ,h,lo\ £ ^^ 
P = [Pn+q-l,Pn+q-2, ■ ■ ■ ,Pl,PoV ^ ^"^' 
Q^ = ['^2n+g-25^2n+q-3' • • • ''^l''^o] ^^ 

li,Pi,a* are the coefficients of 

Lis) = s"-i + /„_2s"-2 + ... + l^s + lo = s"-^ + ra„_2(s) 

P{s) = p„+g_ls"+«-^ + p„+q_2s"+^"^ + ---+PlS + P0= p^an+q-l{s) 

A*{s) = s2"+''-i + a;„^^_2s2"+^-2 + . . ■ + als + a*o = s'^+''-' + a*^ a2n+q-2{s) 

The coprimeness of QmRp, Zp guarantees that Si is nonsingular; therefore, 
the coefficients of L(s), P{s) may be computed from the equation 

Using (7.3.6), the closed- loop plant is described by 

ZpM 
Vp = -j^Vm (7.3.8) 

Similarly, from the plant equation in (7.3.1) and the control law in (7.3.3) 

and (7.3.6), we obtain 

RpM 
Up = -^^Vm (7.3.9) 
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Figure 7.2 Block diagram of pole placement control. 



Because y-m £ -Coo and 
that yp, Up e £, 



Z„M RnM 



are proper with stable poles, it follows 

1. Therefore, 



A* ' A 
for any polynomial M(s) of degree n + q 

the pole placement objective is achieved by the control law (7.3.3) without 

having to put any additional restrictions on M(s),Qm{s). When ym = 0, 

(7.3.8), (7.3.9) imply that yp,Up converge to zero exponentially fast. 

When ym / 0, the tracking error ei = yp — ym is given by 



ei 



ZpM 



A* 



A* 



-ym 



:fiM-P)yn 



LRp 

~A*' 



'mym 



(7.3.10) 



For zero tracking error, (7.3.10) suggests the choice of M(s) = P{s) to null 
the first term in (7.3.10). The second term in (7.3.10) is nulled by using 
QmUm = 0. Therefore, for M(s) = P{s)., we have 



ei 



A*^ J 



LRp 

~A*' 



[0] 



Because ^, — ^ 



-^li- are proper with stable poles, it follows that ei converges 
exponentially to zero. Therefore, the pole placement and tracking objective 
are achieved by using the control law 



WmJ-'Up 



-P{yp - Vm) 



(7.3.11) 



which is implemented as shown in Figure 7.2 using n + q — 1 integrators 
to realize C{s) = n (s\l(s') • Because L{s) is not necessarily Hurwitz, the 
realization of (7.3.11) with n + q—1 integrators may have a transfer function, 
namely C(s), with poles outside C~ . An alternative realization of (7.3.11) is 
obtained by rewriting (7.3.11) as 



Ur, 



A-LQr, 
A 



iVp 



(7.3.12) 
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A{s) - Qm{s)L{s) 
A{s) 



Gp{s) 



Vp 



Figure 7.3 An alternative realization of the pole placement control. 

where A is any monic Hurwitz polynomial of degree n+q—1. The control law 
(7.3.12) is implemented as shown in Figure 7.3 using 2(n + g— 1) integrators 
to realize the proper stable transfer functions ~ /^"^ , X" ^^ summarize the 
main equations of the control law in Table 7.1. 

Remark 7.3.1 The MRC law of Section 6.3.2 shown in Figure 6.1 is a 
special case of the general PPC law (7.3.3), (7.3.6). We can obtain the 
MRC law of Section 6.3.2 by choosing 



Qr 



1, A* — ZpAoRrn, 



M{s) 



RmAo 



L{s) = A(s) - efan-2{s), P{s) = -{9fan-2{s) + eiA{s)) 

A = AoZm, Vn 






where Zp, Aq, Rm are Hurwitz and Aq, Rm, kp,6l,92,0'^,r are as defined 
in Section 6.3.2. 

Example 7.3.1 Consider the plant 



Vp . ^p 

s + a 

where a and b are Icnown constants. The control objective is to choose Up such that 
the poles of the closed-loop plant are placed at the roots of A*{s) = (s + 1)^ and 
yp tracks the constant reference signal j/„j = 1. Clearly the internal model of ?/„ is 
Qm{s) = s, i.e., q = I. Because n = 1, the polynomials L,P, A are of the form 



L(s) = 1, P{s)=pis + po, A = s-|-Ao 
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Table 7.1 PPC law: polynomial approach 



Plant 


Zp{s) 

yp = Rp{s)Up 


Reference input 


Qm{s)ym = 


Calculation 


Solve for L(.s) = s""! + l^On-is) and 
P{s)=p an+q-i{s) the polynomial equation 
L{s)Q^{s)Rp{s) + P{s)Zp{s) = A*{s) 
or solve for Pi the algebraic equation Si(3i = a^, 
where Si is the Sylvester matrix of RpQm, Zp 

ig = [o,...,o,i,i^V e7e"+« 

a*i = [0,...,0,l,a*^]^ e7^2(n+g) 

9 


Control law 


Up — j^ Up ^ ei 
ei = Up- Um 


Design variables 


A*(s) is monic Hurwitz; Qm{s) is a monic poly- 
nomial of degree q with nonrepeated roots on juj 
axis; A(s) is a monic Hurwitz polynomial of degree 

n + q-l 



where Aq > is arbitrary and po,pi are calculated by solving 

s{s + a) + {piS + po)b = {s+ if 
Equating the coefficients of the powers of s in (7.3.13), we obtain 

2-a 1 

Tin = — 



Pi 



Po 



(7.3.13) 
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Equation (7.3.13) may be also written in the form of the algebraic equation (7.3.7), 
i.e., the Sylvester matrix of s{s + a), 6 is given by 







1 















Si = 


c 
C 


I 1 

a 



b 










_ C 








b 




and 











' " 


(3i = 


1 
Pi 


' 


a*i = 




1 
2 
1 


Therefore, the PPC law is given by 








(s + Ao - s) 


p ~ 


'2- 


a 


1 

^+6 


s + \o 


b 




Ao 


1, — 


_{_ 


2-a 


)s+l 


Pi 





s + X, 



-ei 



s + Ao '^ b{s + \n) 
where ei = yp — ym = Vp — ^- A state-space realization of the control law is given 

by 

01 = -Aoi^i + Wp 

</>2 = -Ao02 + ei 

, , 1 — 2Ao + aAo J 2 — a 

Up = Xocpi ; (p2 1 — ei 

6 

V 



7.3.3 State- Variable Approach 

An alternative approach for deriving a PPC law is to use a state observer 
and state-variable feedback. 

We start by considering the expression 



Rp{s) 



(7.3.14) 



for the tracking error. Filtering each side of (7.3.14) with Trni^ where Qi{s) 

is an arbitrary monic Hurwitz polynomial of degree q, and using Qm{s)ym = 

we obtain 

ZpQi _ 

ei = ^i-^:^ Ur, 



J^p^m 



(7.3.15) 
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where 



u„ 






(7.3.16) 



With (7.3.15), we have converted the tracking problem into the regulation 
problem of choosing Up to regulate ei to zero. 

Let (A,B,C) be a state space realization of (7.3.15) in the observer 
canonical form, i.e.. 



e 
ei 



Ae + Bup 



where 



A 





In+q-l 


-ei 











B = ei, c = [i,o,...,o]" 



(7.3.17) 



(7.3.18) 



„n+(7 



9\, 02 e7?,"^'^are the coefficient vectors of the polynomials Rp{s)Qmis) 
and Zp(s)Qi{s), respectively. Because RpQm, Zp are coprime, any possible 
zero-pole cancellation in (7.3.15) between Qi{s) and Rp{s)Qm(s) will oc- 
cur in C~ due to Qi{s) being Hurwitz, which implies that {A,B) is always 
stabilizable. 

We consider the feedback law 



IXnC. Un 



Qi 



O '^ 
where e is the state of the full-order Luenberger observer 

'e = Ae + Bup - Ko{C^e - ei) 

and Kc and Kq are calculated from 

det(.sl- A + BKc) = ^*(s) 

det(s/ -A + KoC^) = Al{s) 



(7.3.19) 

(7.3.20) 

(7.3.21) 

(7.3.22) 



where A*^ and A*^ are given monic Hurwitz polynomials of degree n + q. The 
roots of A*(s) = represent the desired pole locations of the transfer function 
of the closed- loop plant whereas the roots of A*(s) are equal to the poles of 
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the observer dynamics. As in every observer design, the roots of A*(s) = 
are chosen to be faster than those of Al(s) = in order to reduce the effect 
of the observer dynamics on the transient response of the tracking error ei. 
The existence of Kc in (7.3.21) follows from the controllability of (A,B). 
If (A, B) is stabilizable but not controllable because of the common factors 
between (5i(s), i?p(s), the solution for K^ in (7.3.21) still exists provided 
A*^{s) is chosen to contain the common factors of Qi,Rp. Because ^*(s) 
is chosen based on the desired closed-loop performance requirements and 
Qi{s) is an arbitrary monic Hurwitz polynomial of degree q, we can choose 
Qi{s) to be a factor of Al(s) and, therefore, guarantee the existence of Kc 
in (7.3.21) even when {A,B) is not controllable. The existence of Kq in 
(7.3.22) follows from the observability of (C, A). Because of the special form 
of (7.3.17) and (7.3.18), the solution of (7.3.22) is given by i^„ = a* - 61 
where Oq is the coefficient vector of ^o(^)- 

Theorem 7.3.1 The PPC law (7.3.19) to (7.3.22) guarantees that all sig- 
nals in the closed-loop plant are hounded and ei converges to zero exponen- 
tially fast. 

Proof We define the observation error Co = e — e. Subtracting (7.3.20) from 
(7.3.17) we have 

eo={A-KoC^)eo (7.3.23) 

Using (7.3.19) in (7.3.20) we obtain 

'e={A- BKc)e + KoC^eo (7.3.24) 

Because A — KqC^ , A — BK^ are stable, the equilibrium Coe = 0, Cg = of (7.3.23), 
(7.3.24) is e.s. in the large. Therefore e, Bq G Coo and e{t),eo{i) — > as t — > oo. 
From Co = e — e and Up = —KcC, it follows that e, Up, ei G C^c and e(t), Up{t), 
ei(t) ^ as t ^ c». The boundedness of j/p follows from that of ei and j/„j. We 
prove that Up € Ceo as follows: Because of Assumption P3 and the stability of 
Qi{s), the polynomials ZpQi, RpQ„i have no common unstable zeros. Therefore 
there exists polynomials X, Y of degree n + q — I with X monic that satisfy the 
Diophantine equation 

RpQmX + ZpQiY = A* (7.3.25) 

where A* is a monic Hurwitz polynomial of degree 2(n + q) — I that contains the 
common zeros of Qi{s), Rp{s)Qm{s)- Dividing each side of (7.3.25) by A* and using 
it to filter Up, we obtain the equation 

RpQmX QiYZp _ 

'a* "^ 'a* "^ ~ "^ 
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Because QmUp = QiUp and ZpUp = RpUp, we have 



RjjXQi QiYRp 

^7^"p + — T^yp 



Because the transfer functions operating on Up, Hp are proper with poles in C , then 
Up, Up G Ceo imply that Up G Coo and the proof is complete. □ 



The main equations of the state variable feedback law are summarized 
in Table 7.2. 

Example 7.3.2 Let us consider the same plant and control objective as in Example 
7.3.1, i.e., 

Plant w„ = Uri 

Control Objective Choose Up such that the closed-loop poles are placed at the 
roots of A*{s) = {s + 1)^ and yp tracks y^ = 1. 

Clearly, the internal model of y„i is Qm.{s) = s and the tracking error ei = 
Vp - Vm satisfies 



ei 



s + a 



Up Vm 



Filtering each side of the above equation with j|^, i.e., using Qi{s) = s + 1, we 
obtain 

ei = T^^up (7.3.26) 

(s + ajs 

where Up = jxfUp. The state-space realization of (7.3.26) is given by 



-a 1 


ei = [1 0]e 
The control law is then chosen as follows: 



bUr. 



Observer 



Control Law 



-a 1 




e + 



-JXqG^ tip 



bUp-KQ{[l 0]e-ei) 



■lp = Up+ I Up{T)dT 



where Ko = [fcou/Co^]^, K^, = [^^1,^02] are calculated using (7.3.21) and (7.3.22). 
We select the closed-loop polynomial Al{s) = {s + 1)^ and the observer polynomial 

A*(s) = (s -I- 5)^ and solve 



det(sJ - A + BKc) = {s+ l)^ det(s/ - A+ KoC^) = {s + 5f 
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Table 7.2 State-space pole placement control law 



Plant 



yp ~ Rp(s)^p 



Reference input 



Qm{s)yn 



Observer 



A 



C 



■ Ae + Bup- Ko{C^ e-ei] 



, B 





In+q-l 


-e*, 











[1,0, ...,0], ei = yp -Vni 
where ^J , ^2 ^ T^^^^ are the coefficient vectors 
of Rp(s)Qmis) — s""*"^ and Zp(s)Qi(s), respec- 
tively 



Calculation 



Ko = Oq — 61 where a^ is the coefficient vector of 
Al{s) — s"+^; Kc is solved from 
det{sI-A + BKc) = Al{s) 



Control law 



Up — i\c6. Up 



Qm(s)"'P 



Design variables 



^*(s),^*(s) are monic Hurwitz polynomials of 
degree n + q; Qi{s) is a monic Hurwitz polyno- 
mial of degree q; A*(s) contains Qi{s) as a fac- 
tor; Qm{s) is a monic polynomial of degree q with 
nonrepeated roots on the juo axis 



where 



for Ko, Kc to obtain 



-a 1 




B 



C^ = [1,0] 



X, = -[l-a,l], X„ = [10-a,25]^ 
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Note that the solution for Kc holds for any a and 6 7^ 0. For a = 1 and 6 7^ the 
pair 



-a 1 




is uncontrollable due to a zero-pole cancellation in (7.3.26) at s = — 1. Because, 
however, A*{s) = (s+l)^ contains s+l as a factor the solution oi Kc still exists. The 
reader can verify that for A*(s) = (s + 2)^ (i.e., A*{s) doesnot have Qi(s) = s + 1 
as a factor) and a = 1, no finite value of K^ exists to satisfy (7.3.21). V 



7.3.4 Linear Quadratic Control 

Another method for solving the PPC problem is using an optimization tech- 
nique to design a control input that guarantees boundedness and regulation 
of the plant output or tracking error to zero by minimizing a certain cost 
function that reflects the performance of the closed-loop system. As we have 
shown in Section 7.3.3, the system under consideration is 

e = Ae + Bup 

ei = C^e (7.3.27) 

where Up is to be chosen so that the closed-loop system has eigenvalues that 
are the same as the zeros of a given Hurwitz polynomial ^*(s). If the state 
e is available for measurement, then the control input 

Up = -KcS 

where Kc is chosen so that A — BK^ is a stable matrix, leads to the closed- 
loop system 

e= {A-BKc)e 

whose equilibrium Cg = is exponentially stable. The existence of such Kc is 
guaranteed provided {A, B) is controllable (or stabilizable). In Section 7.3.3, 
Kc is chosen so that det(s/ — A + BKc) = Al(s) is a Hurwitz polynomial. 
This choice of Kc leads to a bounded input Up that forces e, ei to converge 
to zero exponentially fast with a rate that depends on the location of the 
eigenvalues of ^ — BKc, i-e., the zeros of A*(s). The rate of decay of ei to 
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zero depends on how negative the real parts of the eigenvalues of ^ — BKc 
are. It can be shown [95] that the more negative these values are, the larger 
the value of Kc and, therefore, the higher the required signal energy in Up. 
In the limit, as the eigenvalues of A — BKc are forced to — oo, the input Up 
becomes a string of impulsive functions that restore e(t) instantaneously to 
zero. These facts indicate that there exists a trade-off between the rate of 
decay of ei, e to zero and the energy of the input Up. This trade-off motivates 
the following linear quadratic control problem where the control input Up is 
chosen to minimize the quadratic cost 



J = (e| + Xu^)dt 

where A > 0, a weighting coefficient to be designed, penalizes the level of the 
control input signal. The optimum control input Up that minimizes J is [95] 

Up = -Kce, Kc = X-^B'^P (7.3.28) 

where P = P~^ > satisfies the algebraic equation 

A~^P + PA- PBX-'^B'^P + CC^ =0 (7.3.29) 

known as the Riccati equation. 

Because (A, B) is stabilizable, owing to Assumption P3 and the fact that 
Qi{s) is Hurwitz, the existence and uniqueness of P = P > satisfying 
(7.3.29) is guaranteed [95]. It is clear that as A ^ 0, a situation known as low 
cost of control, \\Kc\\ -^ oo, which implies that Up may become unbounded. 
On the other hand if A -^ cx), a situation known as high cost of control, 
■Up ^ if the open-loop system is stable. If the open loop is unstable, then 
Up is the one that minimizes /q°° Updt among all stabilizing control laws. In 
this case, the real part of the eigenvalues of ^ — BKc may not be negative 
enough indicating that the tracking or regulation error may not go to zero 
fast enough. With A > and finite, however, (7.3.28), (7.3.29) guarantee 
that A — BKc is a stable matrix, e, ei converge to zero exponentially fast, 
and Up is bounded. The location of the eigenvalues of ^ — BKc depends on 
the particular choice of A. For a given A > 0, the polynomial 

/(S) = Rp{s)Qra{s)Rp{-s)Qrn{-s) + X-^ Zp{s)Qi{s)Zp{-s)Qi{-s) 
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is an even function of s and /(s) = has a total of 2(n + q) roots with 
n + q of them in C~ and the other n + q in C"*". It can be shown that the 
poles corresponding to the closed-loop LQ control are the same as the roots 
of /(s) = that are located in C~ [6]. On the other hand, however, given 
a desired polynomial A*(s), there may not exist a A so that det(s/ — A + 
BX~^B P) = A*{s). Hence, the LQ control solution provides us with a 
procedure for designing a stabilizing control input for the system (7.3.27). 
It doesnot guarantee, however, that the closed-loop system has the same 
eigenvalues as the roots of the desired polynomial A*(s). The significance 
of the LQ solution also relies on the fact that the resulting closed- loop has 
good sensitivity properties. 

As in Section 7.3.3, the state e of (7.3.28) may not be available for mea- 
surement. Therefore, instead of (7.3.28), we use 

Up = -Kci, Kc = X-^B'^P (7.3.30) 

where e is the state of the observer equation 

'e = Ae + Bup- Ko{C'^e-ei) (7.3.31) 

and Ko = a^ — 6\ as in (7.3.20). As in Section 7.3.3, the control input is 
given by 

Qi{s) _ 



Qrn{s) 



(7.3.32) 



Theorem 7.3.2 The LQ control law (7.3.30) to (7.3.32) guarantees that 
all signals in the closed-loop plant are hounded and ei(t) ^ as t ^ oo 
exponentially fast. 

Proof As in Section 7.3.3, we consider the system described by the error equations 

eo = {A- KoC^)eo 

'e={A-BK^)e + KoC^eo {i -o-oo) 

where Kc = \~^B^ P and Kg is chosen to assign the eigenvalues of A — KgC^ to 
the zeros of a given Hurwitz polynomial A*(s). Therefore, the equilibrium Gog = 0, 
Ce = is e.s. in the large if and only if the matrix A — BK^ is stable. We establish 
the stability of A — BKc by considering the system 

^={A- BKc)e={A-X-^BB^P)e (7.3.34) 
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and proving that the equilibrium Eg = is e.s. in the large. We choose the Lyapunov 
function 

V{e) = e^Pe 

where P = P^ > satisfies the Riccati equation (7.3.29). Then V along the 
trajectories of (7.3.34) is given by 

V = -e^CC^e - X-^e^PBB'^Pe = -{C'^ef - -{B^Pef < 

A 

which implies that ee = is stable, e G Coo and C^e, B^ Pe G C2- We now rewrite 
(7.3.34) as 

k={A- KoC^)e + KoC^e - \bB^ Pe 

A 

by using output injection, i.e., adding and subtracting the term KqC^c. Because 
A — KqC^ is stable and C^e, B^ Pe G £oo C\^2, it follows from Corollary 3.3.1 that 
e G Coo n ^2 and e ^ as t ^ c». Using the results of Section 3.4.5 it follows that 
the equilibrium Ce = is e.s. in the large which implies that 

A - BKc = A- \-^BB^P 

is a stable matrix. The rest of the proof is the same as that of Theorem 7.3.1 and 
is omitted. □ 



The main equations of the LQ control law are summarized in Table 7.3. 
Example 7.3.3 Let us consider the scalar plant 

X = —ax + bup 
Vp = X 

where a and b are known constants and 6 7^ 0. The control objective is to choose 
Up to stabilize the plant and regulate yp,x to zero. In this case Qm{s) = Qi{s) = 1 
and no observer is needed because the state x is available for measurement. The 
control law that minimizes 



J= / {y'j, + Xuj,)dt 
Ja 

is given by 

Up = --bpyp 
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Table 7.3 LQ control law 



Plant 


Zp{s) 

yp ~ Rp{s)^p 


Reference input 


Qm{s)ym = 


Observer 


As in Table 7.2 


Calculation 


Solve for P = P~^ > the equation 
A'^P + PA- PBX-^B^P + CC^ = 
A, B, C as defined in Table 7.2 


Control law 




Design variables 


A > penalizes the control effort; Qi{s),Qm{s) 
as in Table 7.2 



where p > is a solution of the scalar Riccati equation 

-2ap- i-— + 1 = 
A 

The two possible solutions of the above quadratic equation are 



Pi = T3 ' P2 = 



62 



62 



It is clear that pi > and p2 < 0; therefore, the solution we are looking for is 
p = Pi > 0. Hence, the control input is given by 



,2, bi 



Vp 
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that leads to the closed-loop plant 



62 

which implies that for any finite A > 0, we have x G Coo and x{t) ^ as i ^ c» 
exponentially fast. It is clear that for A — > the closed- loop eigenvalue goes to 
— cx). For A ^ oo the closed-loop eigenvalue goes to —\a\, which implies that if 
the open-loop system is stable then the eigenvalue remains unchanged and if the 
open-loop system is unstable, the eigenvalue of the closed-loop system is flipped to 
the left half plane reflecting the minimum effort that is required to stabilize the 
unstable system. The reader may verify that for the control law chosen above, the 
cost function J becomes 



J= A 



62 



-x\0) 



It is clear that if a > 0, i.e., the plant is open-loop stable, the cost J is less than when 
a < 0, i.e., the plant is open- loop unstable. More details about the LQ problem 
may be found in several books [16, 95, 122]. V 



Example 7.3.4 Let us consider the same plant as in Examples 7.3.1, i.e. 

6 



Plant 



Vp 



s + a 



Control Objective Choose Up so that the closed-loop poles are stable and yp 
tracks the reference signal ym = 1. 

Tracking Error Equations The problem is converted to a regulation problem 
by considering the tracking error equation 



ei 



6(5 -H) 
(s -I- a)s 



Up^ Up 



s+1 



where ei = j/p — ym generated as shown in Example 7.3.2. The state-space repre- 
sentation of the tracking error equation is given by 



-a 1 




bUr. 



ei = [l,0]e 
Observer The observer equation is the same as in Example 7.3.2, i.e., 



-a 1 




e + 



bUp-K,{[l 0]e-ei) 
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where Kq = [10 — a, 25]^ is chosen so that the observer poles are equal to the roots 

oiAl{s) = {s + 5)\ 

Control law The control law, according to (7.3.30) to (7.3.32), is given by 

s + 1 

Ur, = — A^ [b.b]Pe, Up = u„ 

s 

where P satisfies the Riccati equation 



— a 


1 


1 


' -a 1 ' 




■ b ' 








P + p 





- P 


b 



X-^[b b]P- 



1 




(7.3.35) 



where A > is a design parameter to be chosen. For A = 0.1, a = —0.5,6 = 2, the 
positive definite solution of (7.3.35) is 



P 



which leads to the control law 



0.1585 0.0117 
0.0117 0.0125 



-[3.4037 0.4829]e, Up 



This control law shifts the open-loop eigenvalues from Ai = 0.5, A2 = to Ai 
-1.01, A2 = -6.263. 

For A = 1, a = —0.5, 6 = 2 we have 

0.5097 0.1046 
0.1046 0.1241 



leading to 



-[1.2287 0.4574]e 



and the closed-loop eigenvalues Ai = — 1.69,A2 = —1.19. 

Let us consider the case where a = 1,6= 1. For these values of a, 6 the pair 



-1 1 




is uncontrollable but stabilizable and the open-loop plant has eigenvalues at Ai = 0, 
A2 = —1. The part of the system that corresponds to A2 = — 1 is uncontrollable. In 
this case, A = 0.1 gives 

' 0.2114 0.0289 
0.0289 0.0471 



P 



and Up = —[2.402 0.760]e, which leads to a closed-loop plant with eigenvalues at 
— 1.0 and —3.162. As expected, the uncontrollable dynamics that correspond to 
A2 = — 1 remained unchanged. V 
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7.4 Indirect APPC Schemes 

Let us consider the plant given by (7.3.1), i.e., 
Up = Gp{s)Up, Gp{s) 



Zp{s) 



Rp{s) 

where Rp{s), Zp{s) satisfy Assumptions PI and P2. The control objective is 
to choose Up so that the closed-loop poles are assigned to the roots of the 
characteristic equation A*{s) = 0, where A*{s) is a given monic Hurwitz 
polynomial, and y^ is forced to follow the reference signal ym £ Coo whose 
internal model Qm{s), i.e., 

Qm{s)ym = 

is known and satisfies assumption P3. 

In Section 7.3, we assume that the plant parameters (i.e., the coefficients 
of Zp(s), Rp{s)) are known exactly and propose several control laws that meet 
the control objective. In this section, we assume that Zp{s),Rp{s) satisfy 
Assumptions PI to P3 but their coefficients are unknown constants; and use 
the certainty equivalence approach to design several indirect APPC schemes 
to meet the control objective. As mentioned earlier, with this approach we 
combine the PPC laws developed in Section 7.3 for the known parameter case 
with adaptive laws that generate on-line estimates for the unknown plant 
parameters. The adaptive laws are developed by ffrst expressing (7.3.1) 
in the form of the parametric models considered in Chapter 4, where the 
coefficients of Zp,Rp appear in a linear form, and then using Tables 4.1 to 
4.5 to pick up the adaptive law of our choice. We illustrate the design of 
adaptive laws for the plant (7.3.1) in the following section. 

7.4.1 Parametric Model and Adaptive Laws 

We consider the plant equation 

Rp{s)yp = Zp{s)up 

where Rp{s) = s"- + an-is"-~^^ hais+ao, Zp{s) = 6„_is"~-'^H ^bis+bo, 

which may be expressed in the form 

[s" + e*Jan.i{s)]yp = e*Jan.i{s)up (7.4.1) 
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where a„_i(s) = [s""\ . . . , s, 1]"^ and 6** = [a„_i, . . . , ao]'^,9l = [6„_i, . . . , 60]"^ 
are the unknown parameter vectors. Filtering each side of (7.4.1) with 



where Ap(s) = s" + A„_is" ^ + • ■ • Aq is a Hurwitz polynomial, we obtain 



rp'c 



(7.4.2) 



where 



yp, 0; = m'^ ^*^^^ 



Ap(s^''^' "^ ' ^ 



"J-i(s) "I-l(«) 



Ap(s) ^' Ap(s) 



-yp 



Equation (7.4.2) is in the form of the linear parametric model studied in 
Chapter 4, thus leading to a wide class of adaptive laws that can be picked 
up from Tables 4.1 to 4.5 for estimating 6* 

Instead of (7.4.1), we can also write 

Vp = (Ap - Rp)—yp + Zp—Up 
i\p i\p 

that leads to the linear parametric model 

yp = 0*x'<P (7.4.3) 

where 9^ = \0l^ , (0* - Ap)^ and Ap = [A„_i, A„_2, • • . , Ao]^ is the coeffi- 
cient vector of Ap(s) — s". Equation (7.4.3) can also be used to generate a 
wide class of adaptive laws using the results of Chapter 4. 

The plant parameterizations in (7.4.2) and (7.4.3) assume that the plant 
is strictly proper with known order n but unknown relative degree n* > 
1. The number of the plant zeros, i.e., the degree of Zp(s), however, is 
unknown. In order to allow for the uncertainty in the number of zeros, 
we parameterize Zp{s) to have degree n — 1 where the coefficients of s* for 
i = m+l,m + 2,...,n— 1 are equal to zero and m is the degree of Zp(s). If 
m < n — 1 is known, then the dimension of the unknown vector 6* is reduced 
to n + m + 1. 

The adaptive laws for estimating on-line the vector 6* or O'^ in (7.4.2), 
(7.4.3) have already been developed in Chapter 4 and are presented in Tables 
4.1 to 4.5. In the following sections, we use (7.4.2) or (7.4.3) to pick up 
adaptive laws from Tables 4.1 to 4.5 of and combine them with the PPC 
laws of Section 7.3 to form APPC schemes. 
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7.4.2 APPC Scheme: The Polynomial Approach 

Let us first illustrate the design and analysis of an APPC scheme based on 
the PPC scheme of Section 7.3.2 using a first order plant model. Then we 
consider the general case that is applicable to an nth-order plant. 

Example 7.4.1 Consider the same plant as in example 7.3.1, i.e., 

b 

where a and h are unknown constants and Up is to be chosen so that the poles of 
the closed-loop plant are placed at the roots of A*{s) = (s + 1)^ = and j/p tracks 
the constant reference signal ym = 1 Vi > 0. 

Let us start by designing each block of the APPC scheme, i.e., the adaptive law 
for estimating the plant parameters a and 6; the mapping from the estimates of a, 
h to the controller parameters; and the control law. 

Adaptive Law We start with the following parametric model for (7.4.4) 

z = e*J(h 



where 

-Vp, <P 



s + X""' " s + X 



LLp 

-Vp 



a 



(7.4.5) 



and A > is an arbitrary design constant. Using Tables 4.1 to 4.5 of Chapter 4, we 
can generate a number of adaptive laws for estimating 9* For this example, let us 
choose the gradient algorithm of Table 4.2 

6p = r£0 (7.4.6) 

z - 6j(f) „ -I- 

where F = F^ > 0, 0p = \h, a\^ and a(t), h{t) is the estimate of a and h respectively. 

Calculation of Controller Parameters As shown in Section 7.3.2, the control 
law 

Up = Up - -ei (7.4.7) 

can be used to achieve the control objective, where A(s) = s + Aq, L{s) = 1, 

Qm{s) = s , P{s) = pis-\- pq, ei = j/p — ym and the coefficients pi,po of P{s) satisfy 
the Diophantine equation 

s{s + a) + {pis + po)b = {s + if (7.4.8) 
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or equivalently the algebraic equation 



whose solution is 



1 












a 


1 




1 







a b 




Pi 







6 _ 




. Po . 






2-a 


Po 


1 




P' b 




b 



(7.4.9) 
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a{t) 


1 










1 




1 





a{t) 


m 







Pl{t) 




2 











m \ 




[ Po{t) J 




1 



Because a and b are unknown, the certainty equivalence approach suggests the use of 
the same control law but with the controller polynomial P{s) = PiS + Pq calculated 
by using the estimates a{t) and b{t) of a and b at each time t as if they were the 
true parameters, i.e., P{s,t) = Pi{t)s + pQ{t) is generated by solving the polynomial 
equation 

s-{.s + a) + {pis + po)-b={s+ 1)2 (7.4.10) 

for pi and pq by treating a{t) and b{t) as frozen parameters at each time t, or by 
solving the algebraic time varying equation 



(7.4.11) 



for Po and pi. The solution of (7.4.10), where a{t) and b{t) are treated as constants 
at each time t, is referred to as pointwise to distinguish it from solutions that may 
be obtained with s treated as a differential operator, and a{t) and b{t) treated as 
differentiable functions of time. 

The Diophantine equation (7.4.10) or algebraic equation (7.4.11) has a unique 
solution provided that (s + a),b are coprime, i.e., provided b ^ 0. The solution is 
given by 

- / X 2-a ^ , ^ 1 

Pi(t) = ^— > Pa(t) = J 

b b 

In fact for a,b £ C^o to imply that pa,pi G Coo, (s+a), b have to be strongly coprime, 
i.e., |6| > bo for some constant bo > 0. For this simple example, the adaptive law 
(7.4.6) can be modified to guarantee that \b{t)\ > 5o > Vt > provided sgn(6) and 
a lower bound bo of |6| are known as shown in Section 7.2 and previous chapters. 
For clarity of presentation, let us assume that the adaptive law (7.4.6) is modified 
using projection (as in Section 7.2) to guarantee \b{t)\ > 6o Vt > and proceed with 
the rest of the design and analysis. 

Control Law The estimates pa{t),pi{t) are used in place of the unknown po, Pi 
to form the control law 



Aq 

1 

s + Xo 



Piit) 



s + Xo 



Po{t) 



1 
s + Xo 



{Vp - Vm) 



(7.4.12) 
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Figure 7.4 Block diagram of APPC for a first-order plant. 



where Aq > is an arbitrary design constant. For simplicity of implementation, 
Aq may be taken to be equal to the design parameter A used in the adaptive law 
(7.4.6), so that the same signals can be shared by the adaptive and control law. 

Implementation The block diagram of the APPC scheme with A = Aq for the 
first order plant (7.4.4) is shown in Figure 7.4. 

For A = Aq, the APPC scheme may be realized by the following equations: 

Filters 



1 = 


-Xcpi + Up, 0i(O) = O 


2 = 


-X(p2 - Vp, (p2{0) = 


n 


-X<t>m + yni, </'m(0) = 



A</'2 + yp = -4>2 



Adaptive Law 



7ie(/<i if |6| > &o or if |6| = b^ and e^isgnfe > 
otherwise 



12^(1)2 








Z -b(j)i- 


- a(j)2 


m^-- 


= 1 +(/.? + 02 



m" 
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Control Law 



Up = \<f)l- {pi{t)\-po{t)){<j)2 + <f)m) -Pl{t){yp-ym) 
Pi 



2-a 1 



where 71, 72, A > are design constants and 6(0)sgn(6) > bo. 

Analysis The stability analysis of the indirect APPC scheme is carried out in the 
following four steps: 

Step 1. Manipulate the estimation error and control law equations to express 
Up, Up in terms of the estimation error e. We start with the expression for the 
normalized estimation error 



em = z — b<pi — a<p2 



H — a<p2 



which implies that 



02 = —b<f)i — a<f)2 — em 
From the control law, we have 

Up = X(pi +Pl{4)2 + 4>m) +P0<I>2 +PO<t'm 

Because Up — X(j)i = 0i, it follows that 

01 = Pl4>2 + Pa4>2 + Vra 

where ym = Pi4'm + Po4>m. Substituting for 02 from (7.4.13) we obtain 
01 = -PiHi - [pia - po)02 - Piem^ + y„ 



(7.4.13) 



(7.4.14) 



Equations (7.4.13), (7.4.14) form the following state space representation for the 
APPC scheme: 



X = A{t)x + bi{t)em'^ + b2y„ 



U,p 

-Vp 



where 

m? = 1 + x^ X and ym ^ C 



x + \x = {A{t) + \I)x + bi{t)em^ + 6227m (7.4.15) 



-pih po-pia 
— b —a 



, b,{t) 



-Pi 
-1 
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Step 2. Show that the homogeneous part of (7.4-15) is e.s. For each fixed t, 
det(s/-^(i)) = {s+a)s+b{pis+po) = {s+lf, i.e., \{A{t)) = -1, Vi > 0. As shown 

in Chapter 4, the adaptive law guarantees that e,a,b & Coo', e, ew, a, b G C^o f] ^2- 
From pi = "^jf^Tpo = t and b^^ G £00 (because of projection), it follows that 

Pi,Po G 'Coo and Pi,Pq G CooC]C2- Hence, ||^(t)|| G 'Coo H ^^2 which together with 
X{A{t)) = —1 Vi > and Theorem 3.4.11 imply that the state transition matrix 
<l>(i, r) associated with A{t) satisfies 

||$(i,T)|| < fcie-'^^^*"^^ V^>T>0 

for some constants fci, fc2 > 0. 

Step 3. Use the properties of the C2S norm and B-G Lemma to establish 
boundedness. For simplicity, let us now denote ||(-)t||2(5 for some (5 > with || • ||. 
Applying Lemma 3.3.3 to (7.4.15) we obtain 

||a;|| < cllem^ll +c, \x{t)\ < c\\em^\\+ c (7.4.16) 

for any 5 G [0,(5i) where (5i > is any constant less than 2fc2, and some finite 
constants c > 0. 

As in the MR AC case, we define the fictitious normalizing signal 

m2^1 + ||u,f +||ypf 

Prom (7.4.15) we have ||Mp|| + ||2/p|| < c||a;|| + c||em^|| + c, which, together with 
(7.4.16), implies that 

rrii < c||em || + c 



Because |0i| < c||Mp||, \(j)2\ < c||j/p|| for 5 G [0,2A), it follows that m = \/l + (f^ (j) < 
crrif and, therefore, 

where g = em G C2 because of the properties of the adaptive law, or 

ra)<c [ e-^^*-''^f{T)m){T)dT + c 
Jo 

where < 6 < 6* and S* = min[2A, Ji], ^i G (0,2fc2). Applying the B-G Lemma, 
we can establish that to/ G >Coo- Because m < cttt./, we have m and therefore 
4'i,<t>2,x,x,Up,yp G £00- 

Step 4. Establish tracking error convergence. We consider the estimation error 
equation 

em^ = -(j)2 - a4>2 - b<pi 
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em'^ = {s + a) — --y.p-b — — -Up (7.4.17) 

Operating on each side of (7.4.17) with s = g^, we obtain 

1 - S '1 

sUni^) = s(s + a) -% — b -u„ — b -u„ (7.4.18) 

by using the property s[xy) = xy + xy. For A = Aq, it follows from the control law 

(7.4.12) that 

s ,. , , 1 

-—-Up = -(pis + Po)— — rei 
s+A s+A 

which we substitute in (7.4.18) to obtain 

s(em^) = s{.s + a) — — r^p + Kpis + po) — — rei - b — -— Up (7.4.19) 

s + A s + A s + A 

Now, because .s{s + a)j^yp = (s + a)j^yp + a^^yp and sei = sj/p - sy™ = sj/p 
(note that sy^n = 0), we have 

sls + a)— — ryp = (s + a)— — rei + a— — -yp 
s+A s+A s+A 

which we substitute in (7.4.19) to obtain 

s{em^) = Us + a)s + b{pis + po) — — rCi + a — -—yp - b — — -Up 
L Js+A s+A s+A 

Using (7.4.10) we have (s + a)s + b{pis + po) = (s + 1)^ and therefore 

, 2, y- ' -J A 1 j; 1 

s{em ) = -^—ei + a^-^yp - b^--Up 

s + A s + A s + A 



{s+ir 


s + A 


s + A 



s(s + A) 2 S + A , 1 s + A j 1 ,^ . „^x 

^1 = (7TTF'" " (TTTF'^n^^ + (TTTF'^Ta"'' ^^•'•'^^ 

Because Up,yp,m,e G >Coo and a,b,em G >Coon'^2i it follows from Corollary 3.3.1 
that ei e >Coo n^2- Hence, if we show that ei G >Coo, then by Lemma 3.2.5 we can 
conclude that ei ^ as ^ ^ c». Since ei = yp = ayp + bup e Coc, it follows that 
ei ^ as t ^ oo. 

We can continue our analysis and establish that e,a,b,pQ,Pi — > as t ^ c». 
There is no guarantee, however, that po,pi, a,b will converge to the actual values 
Po,Pi,a,b respectively unless the reference signal y^, is sufficiently rich of order 2, 
which is not the case for the example under consideration. 
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As we indicated earlier the calculation of the controller parameters po{t) , pi{t) 
at each time is possible provided the estimated plant polynomials {s + a{t)), b{t) are 
strongly coprime, i.e., provided |5(^)| > bo > Wt > 0. This condition implies that 
at each time t, the estimated plant is strongly controllable. This is not surprising 
because the control law is calculated at each time t to meet the control objective 
for the estimated plant. As we will show in Section 7.6, the adaptive law without 
projection cannot guarantee that \b{t)\ > bo > \/t > 0. Projection requires 
the knowledge of bo and sgn(6) and constrains b{t) to be in the region \b{t)\ > 
bo where controllability is always satisfied. In the higher-order case, the problem 
of controllability or stabilizability of the estimated plant is more difficult as we 
demonstrate below for a general nth-order plant. \7 



General Case 

Let us now consider the nth-order plant 

_ ^p(g) 

where Zp(s), Rp{s) satisfy assumptions PI, P2, and P3 with the same control 
objective as in Section 7.3.1, except that in this case the coefficients of Zp, Rp 
are unknown. The APPC scheme that meets the control objective for the 
unknown plant is formed by combining the control law (7.3.12), summarized 
in Table 7.1, with an adaptive law based on the parametric model (7.4.2) 
or (7.4.3). The adaptive law generates on-line estimates 6a, Ob of the coeffi- 
cient vectors, ^* of Rp{s) = s" + 0*^a„_i(s) and 91 of Zp{s) = 0^^a„_i(s) 
respectively, to form the estimated plant polynomials 

Rp{s,t) = s" + 0^a„_i(s), Zp{s,t) = ejan-i{s) 

The estimated plant polynomials are used to compute the estimated con- 
troller polynomials L(s,t),P(s,t) by solving the Diophantine equation 

LQm ■Rp + P-Zp = A* (7.4.21) 

for L, P pointwise in time or the algebraic equation 

Sik = «r (7.4.22) 
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for Pi, where Si is the Sylvester matrix of RpQnn Zp; Pi contains the coeffi- 
cients of L, P; and a^ contains the coefficients of A*(s) as shown in Table 7.1. 
The control law in the unknown parameter case is then formed as 

Up = (A- LQm)-rUp- P-(yp-ym) (7.4.23) 

Because different adaptive laws may be picked up from Tables 4.2 to 4.5, a 
wide class of APPC schemes may be developed. As an example, we present 
in Table 7.4 the main equations of an APPC scheme that is based on the 
gradient algorithm of Table 4.2. 

The implementation of the APPC scheme of Table 7.4 requires that 
the solution of the polynomial equation (7.4.21) for L,P or of the alge- 
braic equation (7.4.22) for Pi exists at each time. The existence of this 
solution is guaranteed provided that Rp(s,t)Q„i(s), Zp(s,t) are coprime at 
each time t, i.e., the Sylvester matrix Si(t) is nonsingular at each time t. 
In fact for the coefficient vectors l,p of the polynomials L,P to be uni- 
formly bounded for bounded plant parameter estimates 9p, the polynomials 
Rp(s, t)Qm{s), Zp{s., t) have to be strongly coprime which implies that their 
Sylvester matrix should satisfy 

|det(5/(t))| >z^o>0 

for some constant vq at each time t. Such a strong condition cannot be 
guaranteed by the adaptive law without any additional modifications, giv- 
ing rise to the so called ^^ stabilizability" or ^^admissibility" problem to be 
discussed in Section 7.6. As in the scalar case, the stabilizability problem 
arises from the fact that the control law is chosen to stabilize the estimated 
plant (characterized by Zp(s, t), Rp{s, t)) at each time. For such a control law 
to exist, the estimated plant has to satisfy the usual observability, controlla- 
bility conditions which in this case translate into the equivalent condition of 
Rp(s,t)Qmis), Rp(s,t) being coprime. The stabilizability problem is one of 
the main drawbacks of indirect APPC schemes in general and it is discussed 
in Section 7.6. In the meantime let us assume that the estimated plant is 
stabilizable, i.e., RpQm,Zp are strongly coprime Vt > and proceed with 
the analysis of the APPC scheme presented in Table 7.4. 

Theorem 7.4.1 Assume that the estim,ated plant polynom,ials RpQm, Zp are 
strongly coprime at each time t. Then all the signals in the closed-loop 
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Table 7.4 APPC scheme: polynomial approach. 



Plant 


Z„(s) 

Zp{s) = ei'an-iis) 


Reference 
signal 


Qm{s)ym = 


Adaptive law 


Gradient algorithm from Table 4.2 

0p = Tecj), r = r^ > 

e={z- ej<p)/m'^, m^ = 1 + (j)'^ (f) 

'p - ^ Ap{s) ^P' Ap(s) yp\ 

'=T$S)VP^ Op=[Oj^GJV 

Zp(s,t) = ejan-iis), Rp(s,t) = s*^ + 0jan-iis) 


Calculation 


Solve for L{s,t) = s"-^ + ra„_2(s), 
P{s,t) = p^ an+q-i{s) the polynomial equation: 
L{s,t)-Qmis)-Rpis,t) + Pis,t)-Zpis,t) = A*is) 
or solve for f3i the algebraic equation 

where Si is the Sylverster matrix of RpQm, Zp 

/3, = [^J,pT]Te7^2("+9), /, = [0, . . . , 0, 1, r]^e7e"+« 

a*i = [0,...,0,l,a*^]^ e7e2(n+g) 

9 


Control law 


Up = (A- LQm)\up - P^iVp - Vm) 


Design 
variables 


A*{s) monic Hurwitz; A(s) monic Hurwitz of degree 
n + q — 1; for simplicity, A(s) = Ap(s)Aq(s), where 
Ap{s),Aq{s) are monic Hurwitz of degree n, q — I, 
respectively 
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APPC scheme of Table 7.4 are u.h. and the tracking error converges to zero 
asymptotically with time. The same result holds if we replace the gradient 
algorithm in Table 7.4 with any other adaptive law from Tables 4-2 and 4-3. 

Outline of Proof: The proof is completed in the following four steps as in Example 
7.4.1: 

Step 1. Manipulate the estimation error and control law equations to express 
the plant input Up and output yp in terms of the estimation error. This step leads 
to the following equations: 

X = A{t)x + bi{t)em'^ + b2ym 
Up = Cj X + diem'^ + d2ym (7.4.24) 

Vp = (^2^ + d^em^ + d^y^ 

where ym £ 'Coo; A(t),bi{i) are u.b. because of the boundedness of the estimated 
plant and controller parameters (which is guaranteed by the adaptive law and the 
stabilizability assumption); 62 is a constant vector; Ci and C2 are vectors whose 
elements are u.b.; and di to ^4 are u.b. scalars. 

Step 2. Establish the e.s. of the homogeneous part of (7.4-24). The matrix Ait) 
has stable eigenvalues at each frozen time t that are equal to the roots of A*[s) = 0. 
In addition 9p,l,p G C2 (guaranteed by the adaptive law and the stabilizability 
assumption), imply that ||j4(i)|| G £2- Therefore, using Theorem 3.4.11, we conclude 
that the homogeneous part of (7.4.24) is u.a.s. 

Step 3. Use the properties of the C25 norm and B-G Lemma to establish 

boundedness. Let m? = 1 + ||itpp + Hl/plP where || • || denotes the C2S norm. Using 
the results established in Steps 1 and 2 and the normalizing properties of mf, we 
show that 

TOy < c||emm/|p + c (7.4.25) 

which implies that 

mj < c e~*(*"^)e^m^m^dT + c 
Jo 

Because em G C2, the boundedness of nif follows by applying the B-G lemma. 

Using the boundedness of mf, we can establish the boundedness of all signals in 

the closed-loop plant. 

Step 4. Establish that the tracking error ei converges to zero. The convergence 
of ei to zero follows by using the control and estimation error equations to express 
ei as the output of proper stable LTI systems whose inputs are in C2 H Ceo- 

The details of the proof of Theorem 7.4.1 are given in Section 7.7. □ 



478 



CHAPTER 7. ADAPTIVE POLE PLACEMENT CONTROL 



7.4.3 APPC Schemes: State- Variable Approach 

As in Section 7.4.2, let us start with a scalar example to illustrate the design 
and analysis of an APPC scheme formed by combining the control law of 
Section 7.3.3 developed for the case of known plant parameters with an 
adaptive law. 



Example 7.4.2 We consider the same plant as in Example 7.3.2, i.e. 

_ b 

Up — I ^p 



(7.4.26) 



where a and b are unknown constants with 6 7^ and Up is to be chosen so that the 
poles of the closed-loop plant are placed at the roots of A*{s) = (s + 1)^ = and 
yp tracks the reference signal ?/,„ = 1. As we have shown in Example 7.3.2, if a,b 
are known, the following control law can be used to meet the control objective: 



-a 1 
_ 

-Kr.e, Ur, 



bUr 



i^„([f 0]e-ei) 



(7.4.27) 



where Kq, Kc are calculated by solving the equations 

det{sl- A+BK^) = {s+lf 
det(s/ -A + KoC^) = {s + 5)2 



where 



I.e., 



-a 1 




B 



b, C" 



[1,0] 



Kr 



-[f-a,l], Xo = [10-a,25]^ 



(7.4.28) 



The APPC scheme for the plant (7.4.26) with unknown a and b may be formed 
by replacing the unknown parameters a and b in (7.4.27) and (7.4.28) with their 
on-line estimates a and b generated by an adaptive law as follows: 

Adaptive Law The adaptive law uses the measurements of the plant input Up and 
output Up to generate a, b. It is therefore independent of the choice of the control 
law and the same adaptive law as the one used in Example 7.4.1 can be employed. 



PrjFec/)}, r = r^ > 
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m 
b ' 
a 



, ^ 



m =1 + 4' (p, z 



s + X -Vp _ 



s + X 



Vp 



(7.4.29) 



where A > is a design constant and Pr {•} is the projection operator as defined in 
Example 7.4.1 that guarantees b{t)\ > 6o > Vi > 0. 



State Observer 

where 



k = A{t)e + B{t)up - Ko{C^e - ei) 



(7.4.30) 



-a 1 




B 



C^ = [1,0] 



Calculation of Controller Parameters Calculate Kc, Ko by solving 

det(.s/ - i + BK^) = Al{s) = (s + if, det(s/ - i + KoC'^) = (s + 5)^ 

for each frozen time t which gives 

1 



Kr 



[l-a,l], Xo = [10 - a, 25] 



(7.4.31) 



Control Law: 



/Vc^i Wp 



(7.4.32) 



The solution for the controller parameter vector Kc exists for any monic Hurwitz 
polynomial A*c{s) of degree 2 provided {A,B) is stabilizable and A*(s) contains the 
uncontrollable eigenvalues of A as roots. For the example considered, (A, B) loses 
its controllability when 6 = 0. It also loses its controllability when 6 7^ and a = 1. 
In this last case, however, (A, _B), even though uncontrollable, is stabilizable and 
the uncontrollable eigenvalue is at s = —1, which is a zero of A*(s) = (s + 1)^. 
Therefore, as it is also clear from (7.4.31), K^ exists for all a, 6 provided 6 7^ 0. 
Because the projection operator in (7.4.29) guarantees as in Example 7.4.1 that 
\b{'t)\ > 60 > Vi > 0, the existence and boundedness of Kc follows from a,b £ Ceo- 

Analysis 

Step 1. Develop the state error equations for the closed-loop APPC scheme. 
The state error equations for the closed-loop APPC scheme include the tracking 
error equation and the observer equation. The tracking error equation 



ei 



b(s+l) 
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is expressed in the state space form 



-a 1 




bu„ 



(7.4.33) 



ei 



C^e= [l,0]e 



Let Bo = e — e be the observation error. Then from (7.4.30) and (7.4.33) we obtain 
the state equations 



Ac{t)e- 



-a+ 10 
25 



-10 1 
-25 



C^eo 



aei 



bur, 



-KrC 



(7.4.34) 



where Ac{i) = A[i) — BKc, a = a — a,b = b — b. The plant output is related to cq, e 
as follows: 



yp = ei + ym = C^{eo + e) + y„ 



(7.4.35) 



The relationship between Up and cq, e may be developed as follows: 

The coprimeness of b, s{s + a) implies the existence of polynomials X{s), Y{s) 
of degree 1 and with X{s) monic such that 



s{s + a)X{s) + b{s + l)Y{s) = A*{s) 



(7.4.36) 



where A*{s) = {s+l)a*{s) and a*{s) is any monic polynomial of degree 2. Choosing 
a*{s) = {s+ 1)2, we obtain X{s) = s -h 1 and Y{s) = (?z:^£±i. Equation (7.4.36) 
may be written as 

s{s + a) {2-a)s + l 



which implies that 



(S + 1)2 (s+l)2 



s{s + a) {2-a)s+l 

J^TW""' ^ (s+l)2 "p 



(7.4.37) 



Using Up 



s-\-a 



yp, sUp = (s -|- l)up and Up 



-KrE, we have 



s -I- a ' , (2 — a)s + 1 (s + a) 
s + 1 [s +1)'^ b 



(7.4.38) 



Equations (7.4.34), (7.4.35), and (7.4.38) describe the stability properties of the 
closed-loop APPC scheme. 

Step 2. Establish the e.s. of the homogeneous part of (7. 4-34)- The homoge- 
neous part of (7.4.34) is considered to be the part with the input aei, bup set equal 
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that Ac{t) is a u.a.s matrix and Ac 



is a stable matrix. Because Aq 



to zero. The e.s. of the homogeneous part of (7.4.34) can be established by showing 

-10 1 

-25 
is stable by design, it remains to show that Ac{t) = A{t) — B{t)Kc{i) is u.a.s. 

The projection used in the adaptive law guarantees as in Example 7.4.1 that 
1^(^)1 > &o > 0, Vf > 0. Because 6, a G Coo it follows that the elements of Kc, Ac are 
u.b. Furthermore, at each time t, X{Ac{t)) = —1,-1, i.e., Ac{t) is a stable matrix 

at each frozen time t. From (7.4.31) and a,b £ C2, we have \Kc\ G ^2- Hence, 
||vlc(^)|| G C2 and the u.a.s of Ac{t) follows by applying Theorem 3.4.11. 

In the rest of the proof, we exploit the u.a.s of the homogeneous part of (7.4.34) 
and the relationships of the inputs aei, bup with the properties of the adaptive 
law in an effort to first establish signal boundedness and then convergence of the 
tracking error to zero. In the analysis we employ the C2S norm ||(-)t||25 which for 
clarity of presentation we denote by || • ||. 

Step 3. Use the properties of the C2S norm and B-G Lemma to establish 
boundedness. Applying Lemmas 3.3.2 and 3.3.3 to (7.4.34), (7.4.35), and (7.4.38), 
we obtain 



Pll 


< 


c\\C^eo\\ 


ypW 


< 


c||C^eo|| + c||e||+c 


"p 


< 


c e + cWnpW + c 



for some S > where c > denotes any finite constant, which imply that 

hpW < c\\C^ec\\ + c 
\\up\\ < c\\C'^ec\\ + c 

Therefore, the fictitious normalizing signal 

m} = l+ Wvpf + \\upf < cWC^eof + c (7.4.39) 

We now need to find an upper bound for ||C^eo||, which is a function of the C2 
signals em,a,b. From equation (7.4.34) we write 



C 60= 7 — —-T^aei 



(s+5)2 ' (5 + 5)2 s+1 P 

Applying the Swapping Lemma A.l (see Appendix A) to the above equation and 
using the fact that sei = syp we obtain 

•^^^o = ^r^^^yp ~ ^ 1k\2 ^p + Wci{Wbiei)h - Wc2{Wb2Up)b (7.4.40) 
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where the elements of Wci{s), Wbi{s) are strictly proper transfer functions with poles 
at —1, —5. To relate the first two terms on the right-hand side of (7.4.40) with em'^, 
we use (7.4.29) and z = 9'^ <j) to write 

em^ = z- e^^ = -6^^ = a-^yp - b-^Up (7.4.41) 



s + X"' s + \ 



We filter both sides of (7.4.41) with ^^^^-^j and then apply the Swapping Lemma A.l 
to obtain 



-em = a 



(, + 5).^-^ ^^^;-^y.-b^Up + W.{iW,yp)a-iW,u,)b} (7.4.42) 

where the elements of Wc{s), Wb{s) are strictly proper transfer functions with poles 
at -5. Using (7.4.42) in (7.4.40), we have that 

C^eo= '}''^^l em^ + G{s,h,i) (7.4.43) 

where 

G{s, h, b) = Wci{Wbiei)h - Wc2{Wb2Up)b - Wc{{Wbyp)h - [WbUpfb] 

Using Lemma 3.3.2 we can establish that 4>/mf, m/nif, Wbiei/mf, Wb2Up/mf, 
Wbyp/frif, WbUp/mf G Coo- Using the same lemma we have from (7.4.43) that 

llC^eoll < c\\emmf\\ + c\\mfii\\ + c\\mfb\\ (7.4.44) 

Combining (7.4.39), (7.4.44), we have 

mj < cWgiJifW^ + c (7.4.45) 

or 

m}<c I e-^'-'-^^g'^{T)m}{T)dT + c 



where ^^(t) = e^m"^ + a +6^. Because em,a,b G C2, it follows that g G C2 
and therefore by applying B-G Lemma to (7.4.45), we obtain ruf G C^c- The 
boundedness of rUf implies that (j),m,Wbiei,Wb2Up,Wbyp,WbUp G £00- Because 

a,b,em'^ G CooC\^2, it follows that C^ Co G Caof]J~-2 by applying Corollary 3.3.1 
to (7.4.43). Now by using C^Gq G Coor\^2 in (7.4.34), it follows from the stability 
of Ac{t) and Lemma 3.3.3 or Corollary 3.3.1 that e G >Coon'C2 and e(i) — > as 
t —> c». Hence, from (7.4.35), we have j/p G £00 and ei G >Coo H ^2 and from 
(7.4.38) that Up G £oo- 
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Step 4. Convergence of the tracking error to zero. Because ei G Cca (due 
to ei = ijp and ijp G >Coo) and ei G ^CooH'^a, it follows from Lemma 3.2.5 that 
ei(t) ^ as i — > oo. 

We can continue the analysis and establish that e, cm ^ as t ^ oo, which 

implies that flp, Kc ^ Q as t ^ oo. 

The convergence of Op to 9* = [b,a]^ and of Kc to -K^c = ^[1 ~ ij 1] cannot be 
guaranteed, however, unless the signal vector (j) is PE. For to be PE, the reference 
signal ym has to be sufficiently rich of order 2. Because ym = 1 is sufficiently rich 
of order 1, (p eTZ"^ is not PE. V 

General Case 

Let us now extend the results of Example 7.4.2 to the nth-order plant (7.3.1). 
We design an APPC scheme for the plant (7.3.1) by combining the state 
feedback control law of Section 7.3.3 summarized in Table 7.2 with any ap- 
propriate adaptive law from Tables 4.2 to 4.5 based on the plant parametric 
model (7.4.2) or (7.4.3). 

The adaptive law generates the on-line estimates Rp(s,t),Zp(s,t) of the 
unknown plant polynomials Rp(s),Zp(s), respectively. These estimates are 
used to generate the estimates A and B of the unknown matrices A and B, 
respectively, that are used to calculate the controller parameters and form 
the observer equation. 

Without loss of generality, we concentrate on parametric model (7.4.2) 
and select the gradient algorithm given in Table 4.2. The APPC scheme 
formed is summarized in Table 7.5. 

The algebraic equation for calculating the controller parameter vector 
Kc in Table 7.5 has a finite solution for Kc{t) at each time t provided the 
pair {A, B) is controllable which is equivalent to Zp{s., t)Qi(s), Rp(s, t)Qm{s) 
being coprime at each time t. In fact, for Kc{t) to be uniformly bounded, 
{A,B) has to be strongly controllable, i.e., the absolute value of the de- 
terminant of the Sylvester matrix of Zp{s.,t)Qi{s), Rp{s,t)Qm{s) has to be 
greater than some constant i^o > foi' all t > 0. This strong controllability 
condition may be relaxed by choosing Qi{s) to be a factor of the desired 
closed- loop Hurwitz polynomial A*(s) as indicated in Table 7.5. By doing 
so, we allow Qi{s), Rp{s,t) to have common factors without affecting the 
solvability of the algebraic equation for Kc, because such common factors are 
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Table 7.5 APPC scheme: state feedback law 



_ Zp{s) 

yp ~ Rp{s)''^p 

an-iis)= [g»-i,g"-^...s,l]^ 



Plant 



Reference 
signal 



Qm{s)ym = 



Adaptive law 



Gradient algorithm based on z = Ot c 



^-ej<, 



r = r' >o 



m? = 1 + S^ ( 



al_i(«) ^Z-i{s) 



Ap(s) "-P' 

iT 



Ap(s) yp 



Apis)yp 



Op - [oJ,dJ\ 

Zp{s,t) = 9j{t)an-i{s),Rp{s,t) = s'' + eJ{t)an-i{s) 



State observer 



k = Ae + Bup-Ko{t){C^e-ei), e e 71"+'? 



A= 



iit) 



hi+q-l 







,B=02it),C^=[l,O,...,O] 



n+q 



OiElTZ''^^'^ is the coefficient vector of RpQm — s 

02 G TZ'^'^'^ is the coefficient vector of ZpQi 

Ko = a* — 6i, and a* is the coefficient vector of 



e"+<J 



Calculation of 

controller 

parameters 



Solve for Kc pointwise in time the equation 
dei{sl- A + BKc) = A%s) 



Control law 



Uv 



-Kc{t)e, Up 



Qm{s) monic of degree q with nonrepeated roots on 
the jcj-axis; Qi{s) monic Hurwitz of degree q; Aq(s) 
monic Hurwitz of degree n+q; A*J^ monic Hurwitz of 
degree n + q and with Qi{s) as a factor; Ap(s) monic 
Hurwitz of degree n 



Design 
variables 
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also included in A*(s). Therefore the condition that guarantees the existence 
and uniform boundedness of Kc is that Zp(s,t), Rp{s,t)Qm{s) are strongly 
coprime at each time t. As we mentioned earlier, such a condition cannot 
be guaranteed by any one of the adaptive laws developed in Chapter 4 with- 
out additional modifications, thus giving rise to the so-called stabilizability 
or admissibility problem to be discussed in Section 7.6. In this section, we 
assume that the polynomials Zp(s,t), Rp{s,t)Q„i{s) are strongly coprime at 
each time t and proceed with the analysis of the APPC scheme of Table 7.5. 
We relax this assumption in Section 7.6 where we modify the APPC schemes 
to handle the possible loss of stabilizability of the estimated plant. 

Theorem 7.4.2 Assume that the polynomials Zp, RpQm are strongly co- 
prime at each time t. Then all the signals in the closed-loop APPC scheme 
of Table 7.5 are uniformly hounded and the tracking error ei converges to 
zero asymptotically with time. The same result holds if we replace the gra- 
dient algorithm with any other adaptive law from Tables J^.2 to 4-4 i^c-t ^^ 
based on the plant parametric model (7.4.2) or (7.4.3). 

Outline of Proof 

Step 1. Develop the state error equations for the closed-loop APPC scheme, 
i.e., 



(7.4.46) 



e 


= A,{t)e+k,C^e, 


eo 


= AoCo + Oiei - hup 


Vp 


= C^Co + C^e + ym 


Up 


= Wi{s)kS)e + W2{s)yp 


Up 


= -k,e 



where Cq = e— e is the observation error, Aq is a constant stable matrix, Wi{s) and 
W2{s) are strictly proper transfer functions with stable poles, and Ac{t) = A — BKc- 

Step 2. Establish e.s. for the homogeneous part of (7.4-46)- The gain Kc is 
chosen so that the eigenvalues of Ac{t) at each time t are equal to the roots of the 
Hurwitz polynomial A*{s). Because A, B ^ C^o (guaranteed by the adaptive law) 
and Zp,RpQm are strongly coprime (by assumption), we conclude that {A, B) is 
stabilizable in a strong sense and Kc,Ac G Coo- Using Oa,Oi, G C2, guaranteed by 

the adaptive law, we have Kc,Ac G C2- Therefore, applying Theorem 3.4.11, we 
have that Ac{t) is a u.a.s. matrix. Because A^, is a constant stable matrix, the e.s. 
of the homogeneous part of (7.4.46) follows. 
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Step 3. Use the properties of the C2S norm and the B-G Lemma to establish 
signal boundedness. We use the properties of the C2S norm and equation (7.4.46) 
to estabhsh the inequality 

nif < c\\gmf\\ + c 

where g"^ = e^m? + \6a\'^ + \0b\'^ and m^ = 1 + ||MpP + ||j/pP is the fictitious 
normalizing signal. Because g& C2, it follows that ni^G Ceo by applying the B-G 
Lemma. Using mrif G C^o, we establish the boundedness of all signals in the closed- 
loop plant. 

Step 4. Establish the convergence of the tracking error ei to zero. This is done 
by following the same procedure as in Example 7.4.2. □ 

The details of the proof of Theorem 7.4.2 are given in Section 7.7. 

7.4.4 Adaptive Linear Quadratic Control (ALQC) 

The linear quadratic (LQ) controller developed in Section 7.3.4 can be made 
adaptive and used to meet the control objective when the plant parameters 
are unknown. This is achieved by combining the LQ control law (7.3.28) to 
(7.3.32) with an adaptive law based on the plant parametric model (7.4.2) 
or (7.4.3). 

We demonstrate the design and analysis of ALQ controllers using the 
following examples: 

Example 7.4.3 We consider the same plant and control objective as in Example 
7.3.3, given by 

X = —ax + bup 
Vp = X (7.4.47) 

where the plant input Up is to be chosen to stabilize the plant and regulate Hp to 
zero. In contrast to Example 7.3.3, the parameters a and b are unknown constants. 
The control law Up = —jbpyp in Example 7.3.3 is modified by replacing the 
unknown plant parameters a, b with their on-line estimates a and b generated by 
the same adaptive law used in Example 7.4.2, as follows: 



Adaptive Law 



dp = Te<f>, r = r^ > 

-I- fh^rh. z = 

S + Xq 



z - ejcj) 2 



m~ = 1 + 4>^4>, z = — — -J/p 
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^p = 


b 
a 


, ^ = 


1 


Up 


S+ Xq 


[ -Vp 


where Aq > is a design constant. 






Control Law 











-b{t)p{t)yp 



(7.4.48) 



Riccati Equation Solve the equation 



-2a{t)p{t) - ^ "■ \ "■ ' +1 = 



at each time t for p{t) > 0, i.e. 



,, -\a+ Vx^a^ + b^X 
p{t) = ^ > 



(7.4.49) 



As in the previous examples, for the solution p{t) in (7.4.49) to be finite, the estimate 
b should not cross zero. In fact, for p(t) to be uniformly bounded, 6(f) should 
satisfy \b(t)\ > bo > 0,Vt > for some constant &o that satisfies \b\ > bo. Using 
the knowledge of bo and sgn(6), the adaptive law for b can be modified as before 
to guarantee \b{t)\ > bo, Vf > and at the same time retain the properties that 
Op G Coc and e,arn,6p G £2 H Coo- The condition \b{t)\ > bo implies that the 
estimated plant, characterized by the parameters a, b, is strongly controllable at 
each time t, a condition required for the solution p{t) > of the Riccati equation 
to exist and be uniformly bounded. 

Analysis For this first-order regulation problem, the analysis is relatively simple 
and can be accomplished in the following four steps: 

Step 1. Develop the closed-loop error equation. The closed- loop plant can be 
written as 



-(a H )x -\- ax — bUp 

A 



(7.4.50) 



by adding and subtracting ax — bUp and using Up = —bpx/X. The inputs ax, bup are 

1 1 - A „ - A ~ , 

due to the parameter errors a = a— a,b=b— b. 

Step 2. Establish the e.s. of the homogeneous part of (7.4.50). The eigenvalue 
of the homogeneous part of (7.4.50) is 
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which is guaranteed to be negative by the choice of p{t) given by (7.4.49), i.e., 



^^P^ ,/-9 . b^ ^ "0 



provided, of course, the adaptive law is modified by using projection to guarantee 
1^(01 > &o,Vi > 0. Hence, the homogeneous part of (7.4.50) is e.s. 

Step 3. Use the properties of the L^i norm and B-G Lemma to establish bound- 
edness. The properties of the input ax — bup in (7.4.50) depend on the properties 
of the adaptive law that generates a and b. The first task in this step is to establish 

the smallness of the input dx — bUp by relating it with the signals a, b, and em that 
are guaranteed by the adaptive law to be in £2- 
We start with the estimation error equation 

em^ = z-e'I<i) = -9J<j> = d x-b u„ (7.4.51) 

^ P s + Ao s + Ao^ 



Operating with (s + Ao) on both sides of (7.4.51) and using the property of differ- 

d_ 
dt 



entiation, i.e., sxy = xy + xy where s = -4 is treated as the differential operator. 



we obtain 

{s + \o)em = ax — bup + a —x — b 7— ^tp (7.4.52) 

s + Aq s + Aq 



2.1 r 1 



Therefore, 

dx — bun = (s + An)£?TT.^ — d x + b u„ 

^ ^ ' s + Ao s + Ao ^ 

which we substitute in (7.4.50) to obtain 

X = —{a H )x + {s + Ao)em^ — d x + b Up (7.4.53) 

A s + Ao s + Ao 

If we define e = x — em? , (7.4.53) becomes 

52 yi ^ ^ ^ ^ 

e = —{d-\ — — )e + (Ao — a —^ern^ — d —x + b —u„ (7.4.54) 

A A s + Ao s + Aq 

X = e + em 

Equation (7.4.54) has a homogeneous part that is e.s. and an input that is small in 

some sense because of em, a, 6 G £2- 

Let us now use the properties of the C2S norm, which for simplicity is denoted 
by II • II to analyze (7.4.54). The fictitious normalizing signal mf satisfies 

m)^l+\\ypr + \\upr<l + c\\xr (7.4.55) 
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for some S > because of the control law chosen and the fact that b,p £ Coo- 
Because x = e + em?, we have ||x|| < ||e|| + ||em^||, which we use in (7.4.55) to 
obtain 

mj < l + c||ef + c||em2f (7.4.56) 

From (7.4.54), we have 

||ef < c\\emY + c||5xf + c||kpf (7.4.57) 

where x = ^\ x, Up = ^\ Up. Using the properties of the C2S norm, it can be 
shown that nif bounds from above m,x,Up and therefore it follows from (7.4.56), 
(7.4.57) that 



mj <1 + c||emm/f + c||am/|p + c||6m/||^ (7.4.58) 



which implies that 



m 



2^11 / -SU-t) 2/ \^2 



< 1 + c / e-'"^'-''>r/{T)mj{T)dT 







A 



i2 



where g^ = e^m? + a -\-h . Since em, d,b G C2 imply that g a L2, the boundedness 
of m,f follows by applying the B-G Lemma. 

Now m,f G Crxi implies that an, x, Up and, therefore, (j) G Coo- Using (7.4.54), 

and the fact that d,b, em?, x = {l/{s + Xo))x, Up = {l/{s + Xo))up G £00, we 
have e G C^o , which implies that x = i/p & Coo , and therefore Up and all signals in 
the closed loop plant are bounded. 

Step 4. Establish that x = yp —> as t —> 00. We proceed as follows: Using 
(7.4.54), we establish that e G C2, which together with em? G C2 imply that x = 
e + em? G C2- Because (7.4.53) implies that x G Coo, it follows from Lemma 3.2.5 
that x{t) — > as t — > cxd. 

The analysis of the ALQ controller presented above is simplified by the fact that 
the full state is available for measurement; therefore, no state observer is necessary. 
Furthermore, the u.a.s. of the homogeneous part of (7.4.50) is established by simply 
showing that the time-varying scalar d + rp/\ > bo/vX > 0, Vi > 0, i.e., that 
the closed-loop eigenvalue is stable at each time t, which in the scalar case implies 
u.a.s. \J 

In the following example, we consider the tracking problem for the same 
scalar plant given by (7.4.47). In this case the analysis requires some addi- 
tional arguments due to the use of a state observer and higher dimensionality. 

Example 7.4.4 Let us consider the same plant as in Example 7.4.3 but with the 
following control objective: Choose Up to stabilize the plant and force z/p to follow 
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the constant reference signal ym{t) = 1- This is the same control problem we solved 
in Example 7.3.4 under the assumption that the plant parameters a and b are known 
exactly. The control law when a, b are known given in Example 7.3.4 is summarized 
below: 



State Observer 
Control Law 
Riccati Equation 

where A = 



= Ae+ Bup- Ko{C^e- ei), ei = j/j, - y„ 

s + 1 
: — A^ [b,b]Pe, Up = Up 

A'^P + PA- PBB^P\-^ + CC'^ = 



-a 1 




B 



b, C^ = [1,0], Ko= [10 -a, 25]^ 



In this example, we assume that a and 6 are unknown constants and use the 
certainty equivalence approach to replace the unknown a, b with their estimates a, b 
generated by an adaptive law as follows: 



State Observer 



i = A{t)e + Bup- ko{t){[l 0]e-ei) 



— a 


1 ■ 


, B -b 


■ 1 ■ 


, K„ - 


■ 10- a " 


[ 


J 




[ i J 




[ 25 J 



(7.4.59) 



Control Law 



b . , s+ 1_ 

■-[1 IJPe, Up = Up 

A S 



(7.4.60) 



Riccati Equation Solve for P{t) = P^ {t) > at each time t the equation 

A'^P+PA-P^^^P+CC^ = , C^ = [l, 0] (7.4.61) 

A 

The estimates a{t) and b{t) are generated by the same adaptive law as in Example 
7.4.3. 

For the solution P = P^ > of (7.4.61) to exist, the pair [A, B) has to be 

stabilizable. Because {A, B, C) is the realization of /^...^ , the stabilizability of 

{A, B) is guaranteed provided 6 7^ (note that for a = 1, the pair (A, B) is 
no longer controllable but it is still stabilizable). In fact for P{t) to be uniformly 
bounded, we require \b{i)\ > 60 > 0; for some constant b^, which is a lower bound for 
|6|. As in the previous examples, the adaptive law for b can be modified to guarantee 
\b{i)\ > ^0: Vi > by assuming that 69 and sgn(6) are known a priori. 

Analysis The analysis is very similar to that given in Example 7.4.2. The tracking 
error equation is given by 



— a 


1 ■ 


e + 


1 " 


[ 


J 




[ i J 



bup, ei = [l,0]e 
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If we define Bq = e — e to be the observation error and use the control law (7.4.60) 
in (7.4.59) , we obtain the same error equation as in Example 7.4.2, i.e., 



Ae{t)e- 



-a+ 10 
25 



C^e„ 



-10 1 
-25 



aei 



6u, 



where Ac{t) = A{t) — BW P/\ and yp, Up are related to Co, e through the equations 

Vp = C^eo + C^e + y^ 

s + aB^P (2- a)s+l s + a 



s-hl A 



(s+1)^ 



If we establish the u.a.s. of A(.(t\ then the rest of the analysis is exactly the 
same as that for Example 7.4.2. 

Using the results of Section 7.3.4, we can establish that the matrix Acit) at each 
frozen time t has all its eigenvalues in the open left half s-plane. Furthermore, 



\K(t)\\<\\A(t)\\ 



2\\B{t)\\\\B{t)\\\\P(t)\\ , ||i?(t)||2||P(f)|| 



A 



A 



where ||A(t)||, ||_B(i)|| G Li due to a, 6 G Li guaranteed by the adaptive law. By 
taking the first-order derivative on each side of (7.4.61), P can be shown to satisfy 



PA,. 



AlP ■ 



-Q 



(7.4.62) 



where 



Q{t) 



. T 

A P+PA 



BB^ BB 
P P- P P 



A 



A 



For a given A, B, and P, (7.4.62) is a Lyapunov equation and its solution P 
exists and is continuous with respect to Q, i.e., ||-P(i)|| < c||(5(i)|| for some constant 
c > 0. Because of ||i(t)||, ||S(i)|| G Li and A,B,P e L^o, we have \\P{t)\\ e Li 
and, thus. Ac{t) G Li. Because Ac{t) is a stable matrix at each frozen time t, we 
can apply Theorem 3.4.11 to conclude that Ac is u.a.s. The rest of the analysis 
follows by using exactly the same steps as in the analysis of Example 7.4.2 and is, 
therefore, omitted. V 
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General Case 

Following the same procedure as in Examples 7.4.3 and 7.4.4, we can design 
a wide class of ALQ control schemes for the nth-order plant (7.3.1) by com- 
bining the LQ control law of Section 7.3.4 with adaptive laws based on the 
parametric model (7.4.2) or (7.4.3) from Tables 4.2 to 4.5. 

Table 7.6 gives such an ALQ scheme based on a gradient algorithm for 
the nth-order plant (7.3.1). 

As with the previous APPC schemes, the ALQ scheme depends on the 
solvability of the algebraic Riccati equation. The Riccati equation is solved 
for each time t by using the on-line estimates A, B of the plant parameters. 
For the solution P{t) = P {t) > to exist, the pair {A,B) has to be 
stabilizable at each time t. This implies that the polynomials Rp{s,t)Qm{s) 
and Zp{s^ t)Qi{s) should not have any common unstable zeros at each frozen 
time t. Because Qi{s) is Hurwitz, a sufficient condition for {A^B) to be 
stabilizable is that the polynomials Rp{s,t)Qmis), Zp(s,t) are coprime at 
each time t. For P{t) to be uniformly bounded, however, we will require 
Rp{s,t)Qmis), Zp(s,t) to be strongly coprime at each time t. 

In contrast to the simple examples considered, the modification of the 
adaptive law to guarantee the strong coprimeness of RpQm, Zp without 
the use of additional a priori information about the unknown plant is not 
clear. This problem known as the stabilizability problem in indirect APPC 
is addressed in Section 7.6 . In the meantime, let us assume that the stabiliz- 
ability of the estimated plant is guaranteed and proceed with the following 
theorem that states the stability properties of the ALQ control scheme given 
in Table 7.6. 

Theorem 7.4.3 Assume that the polynomials Rp{s,t)Qmis), Zp(s,t) are 
strongly coprime at each time t. Then the ALQ control scheme of Table 
7.6 guarantees that all signals in the closed-loop plant are hounded and the 
tracking error ei converges to zero as t ^ oo. The same result holds if we 
replace the gradient algorithm in Table 7.6 with any other adaptive law from 
Tables 4-2 to 4-4 based on the plant parametric model (7.4.2) or (7.4.3). 

Proof The proof is almost identical to that of Theorem 7.4.2, except for some 
minor details. The same error equations as in the proof of Theorem 7.4.2 that 
relate e and the observation error Bq = e — e with the plant input and output also 
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Table 7.6 Adaptive linear quadratic control scheme 



Plant 



yp ~ Rp{s)'"-p 

Zp{s) = 0l^an-i{s), 
Rp{s) = s^ + efan-i{s) 
a„_i(s) 



[s--\s^-^...,s,l] 



Reference 
signal 



VmV'^jyn 



Adaptive law 



Same gradient algorithm as in Table 7.5 to generate 
Zp{s,t) = 9j{t)an-i{s), Rp{s,t) = s" + gj(t)an-i(g) 



e = A{t)e + Bup - Ko{t){C^e - d) 

-'n+q— 1 



State observer 



A{t) 



-Oi 







B{t) = 02{t) 



Ko{t) = a*-ei, C= [1,0,...,0]^ e7e"+« 

9i is the coefficient vector of Rp{s ,t)Qrn{s)—s'^^^ 

02 is the coefficient vector of Zp(s,t)Qi(s) 

a* is the coefficient vector of ^*(s) — s 

01,02, a* e7e"+« 



n+q 



Riccati 
equation 



Solve for P{t) = P^ (t) > the equation 
A^P + pA- kPBB'^P + CC^ = 



Control law 



■{B^Pe, Up 



Qrn{s)^P 



Qm{s) is a monic polynomial of degree q with nonre- 
peated roots on the juj axis; A*^{s) is a monic Hurwitz 
polynomial of degree n + q with relatively fast zero; 
A > as in Table 7.3; Qi{s) is a monic Hurwitz poly- 
nomial of degree q. 



Design 
variables 
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hold here, i.e. 



e : 


= A,{t)( 


I + koC^Co 


(So = 


■ AoCo + 


Oiei + ^a-ft'ce 


Vp- 


= C^e^ 


+ C'^e + y„. 



Up = Wi{s)KS)e + W2{s)yp 

The only difference is that m Ac = A - BKc, we have Kc = B^{t)P{t)/X. If we 
establish that Kc G Coo, and Ac is u.a.s., then the rest of the proof is identical to 
that of Theorem 7.4.2. 

The strong coprimeness assumption about RpQrm Zp guarantees that the so- 
lution P{t) = P'^ {t) > of the Riccati equation exists at each time t and P G Coo- 
This, together with the boundedness of the plant parameter estimates, guarantee 
that B, and therefore Kc G Coo- Furthermore, using the results of Section 7.3.4, 
we can establish that Ac{t) is a stable matrix at each frozen time t. As in Example 
7.4.4, we have 

A A 

and 

PAc + AjP = -Q 



where 

Q = A P + PA 



■ T 

T V PBB^P PBB P 



A A 

which, as shown earlier, imply that ||-P(i)|| and, thus, ||^c(0|| G C2- 

The pointwise stability of Ac together with ||^c(0|| G C2 imply, by Theo- 
rem 3.4.11, that Ac is a u.a.s. matrix. The rest of the proof is completed by 
following exactly the same steps as in the proof of Theorem 7.4.2. □ 



7.5 Hybrid APPC Schemes 

The stability properties of the APPC schemes presented in Section 7.4 are 
based on the assumption that the algebraic equations used to calculate the 
controller parameters are solved continuously and instantaneously. In prac- 
tice, even with high speed computers and advanced software tools, a short 
time interval is always required to complete the calculations at a given time t. 
The robustness and stability properties of the APPC schemes of Section 7.4 



7.b. HYBRID APPC SCHEMES 



495 



Table 7.7 Hybrid adaptive law 



Plant 



Vp 



Rp(s) "P 



Zp{s) = ei ' an-i{s),Rp{s) = s" + ei ' an-i{s) 



an-i{s) 



„n— 1 gn—2 



\...,s,l] 



Adaptive law 



Uk+i) = V + r Jt^ <r)<P{r)dT, k = 0,l, 



Ap(s) "P' Ap(s) ^P 



e = T^, m"' = 



ApW^P 



l + 0^(^, Vie [tfc,tfc+i) 



Rp{s,tk) = s" + 6lj(^_-^ja„_i(s) 
Zp{s,tk) = 6lJ^_^)a„_i(s) 



Design variables 



T5 = tk+i-tk > Tm; 2 -rsAmax(r) > 7, for some 
7 > 0; Ap(s) is nionic and Hurwitz with degree n 



with respect to such computational real time delays can be considerably 
improved by using a hybrid adaptive law for parameter estimation. The 
sampling rate of the hybrid adaptive law may be chosen appropriately to 
allow for the computations of the control law to be completed within the 
sampling interval. 

Let Tm be the maximum time for performing the computations required 
to calculate the control law. Then the sampling period T, of the hybrid 
adaptive law may be chosen as Tg = t^+i — tfc > Tm where {tk : k = 
1,2,.. .} is a time sequence. Table 7.7 presents a hybrid adaptive law based 
on parametric model (7.4.2). It can be used to replace the continuous-time 
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Table 7.8 Hybrid APPC scheme: polynomial approach 



Plant 


Zp{s) 


Reference signal 


Qm{s)ym = 


Adaptive law 


Hybrid adaptive law of Table 7.7 


Algebraic 
equation 


Solve for L{s,tk) = s''-^ + l^ {tk)an-2{s) 
Pis,tk) = p^ {tk)an+q-iis) from equation 
Lis, tk)Qmis)Rpis, tk) + P(s, tk)Zp(s, tk) = A*{s) 


Control law 


K{s) - L{s,tk)Qm{s) P{s,tk). , 

A(.) ^^ A(.) ^y^ y-^ 


Design variables 


A* nionic Hurwitz of degree 2n + q — 1; Qm{s) 
monic of degree q with nonrepeated roots on the 
juj axis; A(s) = Ap(s)Aq(s); Ap(s),Ag(s) monic 
and Hurwitz with degree n, q — 1, respectively 



adaptive laws of the APPC schemes discussed in Section 7.4 as shown in 
Tables 7.8 to 7.10. 

The controller parameters in the hybrid adaptive control schemes of Ta- 
bles 7.8 to 7.10 are updated at discrete times by solving certain algebraic 
equations. As in the continuous- time case, the solution of these equations ex- 
ist provided the estimated polynomials Rp{s, tk)Qm{s), Zp{s, tk) are strongly 
coprime at each time t^. 

The following theorem summarizes the stability properties of the hybrid 
APPC schemes presented in Tables 7.8 to 7.10. 



Theorem 7.5.1 Assume that the polynomials Rp{s,tk)Qmis), Zp(s,tk) are 
strongly coprime at each time t = t^- Then the hybrid APPC schemes given 
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Table 7.9 Hybrid APPC scheme: state variable approach 



Plant 






Reference signal 



Qm{s)ym = 



Adaptive law 



Hybrid adaptive law of Table 7.7. 



State observer 



e = Ak-ie + Bk-iUp - i:o(fc-i)[C^e - ei] Ak-i 



n(k-i) 



[1,0,. ..,o; 



In+q-l 







j{k-l)[ 

Bk-i 



2{k-l)i C 



-^o(fc-l) = «*- ^l(fc-l) ^l{fc-l)> &2(k-l) 

are the coefficient vectors of i?p(s, tk)Qm{s) — s^^^ ^ 
Zp(s,ti^)Qi(s), respectively, a* is the coefficient 
vector of A*(s) - s"+5 



Algebraic 
equation 



Solve for i^c(fc-i) the equation det[s/ — ^fc-i + 



Control law 



-K. 



c(fc-i)e, Up 






-Ur, 



Design variables 



Choose Qm-, Qi, ^o' ^c' Qi s-s in Table 7.5 



in Tables 7.8 to 7.10 guarantee signal boundedness and convergence of the 
tracking error to zero asymptotically with time. 

The proof of Theorem 7.5.1 is similar to that of the theorems in Sec- 
tion 7.4, with minor modifications that take into account the discontinuities 
in the parameters and is given in Section 7.7. 



Table 7.10 Hybrid adaptive LQ control scheme 
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Plant 


Zp{s) 


Reference signal 


Qm{s)ym = 


Adaptive law 


Hybrid adaptive law of Table 7.7. 


State observer 


'e = Ak_ie + Bk-iUp - i^o(fc-i)[G^e - d] 
Ko(k-i), Ak-i, -Bfc-i, C as in Table 7.9 


Riccati equation 


Solve for Pfc_i = Pil_i > the equation 
AJ_ ,Pk- i+Pk- life- i-lPk- iBk-iBj_ ,Pk- 1+ CC^= 


Control law 


1 -^ Qi{s) 
Up= B,,_^Pk-ie, Up= Up 

■^ Wm(S) 


Design variables 


Choose \,Qi{s),Qm{s) as in Table 7.6 



The major advantage of the hybrid adaptive control schemes described in 
Tables 7.7 to 7.10 over their continuous counterparts is the smaller computa- 
tional effort required during implementation. Another possible advantage is 
better robustness properties in the presence of measurement noise, since the 
hybrid scheme does not respond instantaneously to changes in the system, 
which may be caused by measurement noise. 

7.6 Stabilizability Issues and Modified APPC 



The main drawbacks of the APPC schemes of Sections 7.4 and 7.5 is that 
the adaptive law cannot guarantee that the estimated plant parameters or 
polynomials satisfy the appropriate controllability or stabilizability condi- 
tion at each time t, which is required to calculate the controller parameter 
vector 9c- Loss of stabilizability or controllability may lead to computational 
problems and instability. 
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In this section we concentrate on this problem of the APPC schemes and 
propose ways to avoid it. We call the estimated plant parameter vector Op at 
time t stabilizable if the corresponding algebraic equation is solvable for the 
controller parameters. Because we are dealing with time-varying estimates, 
uniformity with respect to time is guaranteed by requiring the level of sta- 
bilizability to be greater than some constant e* > 0. For example, the level 
of stabilizability can be defined as the absolute value of the determinant of 
the Sylvester matrix of the estimated plant polynomials. 

We start with a simple example that demonstrates the loss of stabiliz- 
ability that leads to instability. 

7.6.1 Loss of Stabilizability: A Simple Example 

Let us consider the first order plant 

y = y + bu (7.6.1) 

where 6 / is an unknown constant. The control objective is to choose u 
such that y,u E Coo, and y(t) —i-Oast—^oo. 
If b were known then the control law 

u = -ly (7.6.2) 

b 

would meet the control objective exactly. When b is unknown, a natural 
approach to follow is to use the certainty equivalence control (CEC) law 

2 

Uc = --y (7.6.3) 

b 

where b{t) is the estimate of b at time t, generated on-line by an appropriate 
adaptive law. 

Let us consider the following two adaptive laws: 

(i) Gradient 

6 = 70£ , 6(0) = 6o / (7.6.4) 

where 7 > is the constant adaptive gain. 
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(ii) Pure Least- Squares 

b = P(t)e , fe(0) = 60/0 

^ = -^ %/^^2 ' ^(0)=Po>0 (7.6.5) 

1 + /5o<? 



where P,(p^ TZ^ , 



1 1 



-u 



1 + I3q<P^ s + l s + l 

z = Vf-Vf (7.6.6) 

It can be shown that for [3q > 0, the control law (7.6.3) with h generated 
by (7.6.4) or (7.6.5) meets the control objective provided that b{t) / Vf > 0. 

Let us now examine whether (7.6.4) or (7.6.5) can satisfy the condition 
h{t) / 0, Vi > 0. 

From (7.6.1) and (7.6.6), we obtain 

(7.6.7) 



1 + M^ 
where 6 = 6 — 6 is the parameter error. Using (7.6.7) in (7.6.4), we have 

^=-7 ./^ ,2 (^-^), m = h^ (7.6.8) 

Similarly, (7.6.5) can be rewritten as 

1 + M-^ 

P^^) = - ,r ^2 , , Po>0 (7.6.9) 

It is clear from (7.6.8) and (7.6.9) that for 6(0) = h, h{t) = and b{t) = 
b, Vi > 0; therefore, the control objective can be met exactly with such an 
initial condition for b. 

If (j){t) = over a nonzero finite time interval, we will have 6 = 0, u = 
y = 0, which is an equilibrium state (not necessarily stable though) and the 
control objective is again met. 



7.6. STABILIZABILITY ISSUES AND MODIFIED APPC 



501 




0.5 1 

Estimate b(t) 



Figure 7.5 Output y{t) versus estimate b(t) for different initial conditions 
y(0) and 6(0) using the CEC Uc = -2y/b. 



For analysis purposes, let us assume that 6 > (unknown to the designer) 
For 0/0, both (7.6.8), (7.6.9) imply that 



sgn(6) = 
and, therefore, for 6 > we have 



-sgn(6(t) - b) 



b{t) > if 6(0) < 6 and b{t) < if 6(0) > 6 

Hence, for 6(0) < < 6, 6(i) is monotonically increasing and crosses zero 
leading to an unbounded control Uc- 

Figure 7.5 shows the plots of y{t) vs 6(t) for different initial conditions 
6(0), y(0), demonstrating that for 6(0) < < 6, 6(i) crosses zero leading to 
unbounded closed- loop signals. The value of 6 = 1 is used for this simulation. 

The above example demonstrates that the CEC law (7.6.3) with (7.6.4) 
or (7.6.5) as adaptive laws for generating 6 is not guaranteed to meet the 
control objective. If the sign of 6 and a lower bound for |6| are known, 
then the adaptive laws (7.6.4), (7.6.5) can be modified using projection to 
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constrain b(t) from changing sign. This projection approach works for this 
simple example but its extension to the higher order case is awkward due to 
the lack of any procedure for constructing the appropriate convex parameter 
sets for projecting the estimated parameters. 

7.6.2 Modified APPC Schemes 

The stabilizability problem has attracted considerable interest in the adap- 
tive control community and several solutions have been proposed. We list 
the most important ones below with a brief explanation regarding their ad- 
vantages and drawbacks. 

(a) Stabilizability is assumed. In this case, no modifications are introduced 
and stabilizability is assumed to hold for all t > 0. Even though there is no 
theoretical justification for such an assumption to hold, it has been often 
argued that in most simulation studies, no stabilizability problems usually 
arise. The example presented above illustrates that no stabilizability prob- 
lem would arise if the initial condition of fe(0) happens to be in the region 
6(0) > b. In the higher order case, loss of stabilizability occurs at certain 
isolated manifolds in the parameter space when visited by the estimated 
parameters. Therefore, one can easily argue that the loss of stabilizability 
is not a frequent phenomenon that occurs in the implementation of APPC 
schemes. 

(b) Parameter projection methods [73, 109, 111]. In this approach, the adap- 
tive laws used to estimate the plant parameters on-line are modified using 
the gradient projection method. The parameter estimates are constrained 
to lie inside a convex subset Cq of the parameter space that is assumed to 
have the following properties: 

(i) The unknown plant parameter vector 9* £ Cq. 

(ii) Every member 6p of Co has a corresponding level of stabilizability greater 
than e* for some known constant e* > 0. 

We have already demonstrated this approach for the scalar plant 

_ b 

Up — . Up 
s + a 
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In this case, the estimated polynomials are s + a,b which, for the APPC 
schemes of Section 7.4 to be stable, are required to be strongly coprime. 
This implies that b should satisfy \b{t)\ > 69 for some 60 > for all t > 0. 
The subset Cq in this case is defined as 



Co = {b^n^\ fegn(fe) > 60} 



where the unknown b is assumed to belong to Cq, i.e., |6| > bo. As shown in 
Examples 7.4.1 and 7.4.2, we guaranteed that \b{t)\ > 69 by using projection 
to constrain b{t) to be inside Cq Vt > 0. This modification requires that bo 
and the sgn{b) are known a priori. 

Let us now consider the general case of Sections 7.4 and 7.5 where the 
estimated polynomials Rp{s, t)Qm{s), Zp{s, t) are required to be strongly co- 
prime. This condition implies that the Sylvester matrix Se{Op) of Rp(s,t) 
Qm{s), Zp(s,t) satisfies 

|det5e(6'p)| >e* 

where 6p G 7?.^" is the vector containing the coefficients of Rp{s,t) — s" and 
Zp(s,t), and e* > is a constant. If e* > is chosen so that 

\det Se{0*p)\ >e* >0 

where 9* G TZ'^"' is the corresponding vector with the coefficients of the 
unknown polynomials Rp{s), Zp(s), then the subset Cq may be defined as 



Co = convex subset olV E TZ "" that contains 0] 



where 

P = {^p G Te^"! I det5e(^p)| > e* > 0} 

Given such a convex set Cq, the stabilizability of the estimated parameters 
at each time t is ensured by incorporating a projection algorithm in the 
adaptive law to guarantee that the estimates are in Co, Vt > 0. The projection 
is based on the gradient projection method and does not alter the usual 
properties of the adaptive law that are used in the stability analysis of the 
overall scheme. 

This approach is simple but relies on the rather strong assumption that 
the set Co is known. No procedure has been proposed for constructing such 
a set Co for a general class of plants. 

An extension of this approach has been proposed in [146] . It is assumed 
that a finite number of convex subsets Ci, . . . , Cp are known such that 
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(i) 9* e U^^^Cj and the stabilizability degree of the corresponding plant is 
greater than some known e* > 0. 

(ii) For every 9p £ U^^^^Cj the corresponding plant model is stabilizable with 
a stabilizability degree greater than e*. 

In this case, p adaptive laws with a projection, one for each subset Cj, 
are used in parallel. A suitable performance index is used to select the 
adaptive law at each time t whose parameter estimates are to be used to 
calculate the controller parameters. The price paid in this case is the use 
of p parallel adaptive laws with projection instead of one. As in the case 
of a single convex subset, there is no effective procedure for constructing 
Ci, i = 1,2, ... ,p, with properties (i) and (ii) in general. The assumption, 
however, that 6* £ U^^^^Cj is weaker. 

(c) Correction Approach [40]. In this approach, a subset V in the parameter 
space is known with the 
following properties: 

(i) 9* &T> and the stabilizability degree of the plant is greater than some 
known constant e* > 0. 

(ii) For every 9p ^ V, the corresponding plant model is stabilizable with a 
degree greater than e*. 

Two least-squares estimators with estimates 9p,9p of 9* are run in par- 
allel. The controller parameters are calculated from 9p as long as 9p £ V. 
When 9p ^ V, 9p is reinitialized as follows: 

9p = 9p + P^/^j 

where P is the covariance matrix for the least-squares estimator of 9*, and 
7 is a vector chosen so that 9p &T>. The search for the appropriate 7 can be 
systematic or random. 

The drawbacks of this approach are (1) added complexity due to the 
two parallel estimators, and (2) the search procedure for 7 can be tedious 
and time-consuming. The advantages of this approach, when compared with 
the projection one, is that the subset T> does not have to be convex. The 
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importance of this advantage, however, is not clear since no procedure is 
given as to how to construct V to satisfy conditions (i), (ii) above. 

(d) Persistent excitation approach [17, 49]. In this approach, the reference 
input signal or an external signal is chosen to be sufficiently rich in frequen- 
cies so that the signal information vector is PE over an interval. The PE 
property guarantees that the parameter estimate 9p of 6* converges expo- 
nentially to 9* (provided the covariance matrix in the case of least squares 
is prevented from becoming singular). Using this PE property, and by as- 
suming that a lower bound e* > for the stabilizability degree of the plant 
is known, the following modification is used: When the stabilizability de- 
gree of the estimated plant is greater than £*, the controller parameters 
are computed using 9p; otherwise the controller parameters are frozen to 
their previous value. Since 6p converges to 0*, the stabilizability degree of 
the estimated plant is guaranteed to be greater than e* asymptotically with 
time. 

The main drawback of this approach is that the reference signal or ex- 
ternal signal has to be on all the time, in addition to being sufficiently rich, 
which implies that accurate regulation or tracking of signals that are not rich 
is not possible. Thus the stabilizability problem is overcome at the expense 
of destroying the desired tracking or regulation properties of the adaptive 
scheme. Another less serious drawback is that a lower bound e* > for the 
stabilizability degree of the unknown plant is assumed to be known a priori. 

An interesting method related to PE is proposed in [114] for the sta- 
bilization of unknown plants. In this case the PE property of the signal 
information vector over an interval is generated by a "rich" nonlinear feed- 
back term that disappears asymptotically with time. The scheme of [114] 
guarantees exact regulation of the plant output to zero. In contrast to other 
PE methods [17, 49], both the plant and the controller parameters are esti- 
mated on-line leading to a higher order adaptive law. 

(e) The cyclic switching strategy [166] . In this approach the control input is 
switched between the CEC law and a finite member of specially constructed 
controllers with fixed parameters. The fixed controllers have the property 
that at least one of them makes the resulting closed-loop plant observable 
through a certain error signal. The switching logic is based on a cyclic 
switching rule. The proposed scheme does not rely on persistent excitation 
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and does not require the knowledge of a lower bound for the level of stabi- 
lizability. One can argue, however, that the concept of PE to help cross the 
points in the parameter space where stabilizability is weak or lost is implic- 
itly used by the scheme because the switching between different controllers 
which are not necessarily stabilizing may cause considerable excitation over 
intervals of time. 

Some of the drawbacks of the cyclic switching approach are the complex- 
ity and the possible bad transient of the plant or tracking error response 
during the initial stages of adaptation when switching is active. 

(f) Switched- excitation approach [63]. This approach is based on the use 
of an open loop rich excitation signal that is switched on whenever the 
calculation of the CEC law is not possible due to the loss of stabilizability of 
the estimated plant. It differs from the PE approach described in (d) in that 
the switching between the rich external input and the CEC law terminates 
in finite time after which the CEC law is on and no stabilizability issues arise 
again. We demonstrate this method in subsection 7.6.3. 

Similar methods as above have been proposed for APPC schemes for 
discrete- time plants [5, 33, 64, 65, 128, 129, 189, 190]. 

7.6.3 Switched-Excitation Approach 

Let us consider the same plant (7.6.1) and control objective as in subsec- 
tion 7.6.1. Instead of the control law (7.6.3), let us propose the following 
switching control law 

^^|-2y/& if t e [0,ti)U(ifc+ jfcr,tfc+i) (7 6 10) 

\ c if t e [tk,tk+jkT] 

where c 7^ is a constant. 

i) = Pcpe, 6(0) = 60/0 (7.6.11) 



P = - , , J, 2 , P{0) = P{tk) = P{tk+JT)=poI>0, j = l,2,...,jk 



' I ifte [0,ti)u(tfc+jfcT,tfc+i) 



^°' \ ifte [tfc,tfc+jfcT] 
where £, are as defined in (7.6.6), and 
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• k = 1,2,... 

• ti is the first time instant for wliicli 

|6(ti)| = Kl) 
wliere 

^('^ = § = 'f' ' = '''■- 

• tk is tlie first time instant after t = t^-i + jk-iT for wliicli 

wliere j'fc = 1, 2, . . . is the smallest integer for which 

k 
\ktk+jkr)\ >v{k + Y,Ji) 

and r > is a design constant. 

Even though the description of the above scheme appears complicated, 
the intuition behind it is very simple. We start with an initial guess 6o / 
for b and apply u = Uc = —2y/b. If \b(t)\ reaches the chosen threshold 
1^(1) = |6o|/2, say at t = ti, u switches from n = Uc to n = Ur = c / 0, 
where Ur is a rich signal for the plant considered. The signal Ur is applied for 
an interval r, where r is a design constant, and \b{ti + t)| is compared with 
the new threshold 1/(2) = u{l)/2. If |6(ii + T)| > i^(2), then we switch back to 
u = Uc sX t = ti + T. We continue with u = Uc unless |6(t2)| = i^(3) = i^(l)/3 
for some finite ^2 in which case we switch back to u = Ur. If |6(ti+r)| < /^(2), 
we continue with u = Ur until t = ti + 2t and check for the condition 

|6(ti + 2T)|>K3) = ^ (7.6.12) 

If 6(ti + 2t) satisfies (7.6.12), we switch to u = Uc and repeat the same 
procedure by reducing the threshold v^k) at each step. If b(ti + 2t) does 
not satisfy (7.6.12) then we continue with u = Ur for another interval r and 
check for 

|6(ti + 3r)|>K4) = ^ 
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and repeat the same procedure. We show that the sequences t^, i^{k) con- 
verge in a finite number of steps, and therefore \h{t)\ > z>* > for some 
constant v* and u = Uc for all t greater than some finite time t* . 

In the sequel, for the sake of simplicity and without loss of generality, 
we take c = l,poT = 1 and adjust the initial condition 0(tfc) for the filter 
4> = -^u to be equal to (f){tk) = 1 so that (j){t) = 1 for t £ [tk,tk + jk^] and 
VA;> 1. 

Let us start with a "wrong" initial guess for b(0), i.e., assume that 6 > 
and take 6(0) < 0. Because 

h = -P^\b-b)/(i + M'') 

and P{t) > 0, for any finite time t, we have that b > for b(t) < b where 
5(t) = if and only if (f)(t) = 0. Because (f)(t) = 1 Vt > 0, b(t), starting from 
6(0) < 0, is monotonically increasing. As b(t) increases, approaching zero, it 
satisfies, at some time t = ti, 

b{h) = -u{l) = -\bo\/2 

and, therefore, signals the switching of the control law from u = Uc to u = Ur, 
i.e., for t > ti, we have 

u = Ur = 1 

P = -P^<j?, P{h)=po (7.6.13) 

b=-P(P^{b-b) (7.6.14) 

The solutions of (7.6.13) and (7.6.14) are given by 

P(t) = P^ -, t > h 

m = b + . ]. , , (fe(ti) - 6), t>ti 

We now need to monitor b{t) at t = ti + j'lr, ji = 1,2,... until 

v{l) + b 



Wi+jiT) 



b 



1+Ji 



> (because pqt = 1) (7.6.15) 

1 +Ji 
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is satisfied for some j'l and switcli to u = Uc at t = ti + jiT. We liave 

Wt,+J,r„^^^ (7,6,16) 

Let jl be tlie smaliest integer for wliicli bjl > i^(l). Tlien, Vj'i > Jl, condition 
(7.6.15) is tlie same as 

m+nr)\ = Kt,+nr) = ^:=^ > -^ (7.6.17) 

Hence, for ji = 2j|, (7.6.17) is satisfied, i.e., by applying the rich signal 
u = Ur = 1 for 2jl intervals of length r, 6(t) passes through zero and 
exceeds the value of u* = z>(l)/(l + 2jJ) > 0. Because b{t) > 0, we have 
6(t) > 1^* , Vt > ti + 2j\t and therefore u = Uc= — 2y/6, without any further 
switching. 

Figure 7.6 illustrates typical time responses of y, u and h when the 
switched-excitation approach is applied to the first order plant given by 
(7.6.1). The simulations are performed with 6=1 and 6(0) = —1.5 . At 
t = ti « 0.2s, h{ti) = u{l) = 6(0)/2 = -0.75, the input u = Uc = -2y/b 
is switched to u = n^ = 1 for a period r = 0.25s. Because at time t = 
ti + T, b(ti + r) is less than z^(2) = z^(l)/2, u = n,- = 1 is applied for another 
period r. Finally, at time t = ti + 2r, b(t) > z>(3) = i^(l)/3, therefore u 
is switched back to u = Uc- Because 6(t) > z>(l)/3, Vt > 0.7s, no further 
switching occurs and the exact regulation of y to zero is achieved. 

General Case 

The above example may be extended to the general plant (7.3.1) and control 
objectives defined in the previous subsections as follows. 

Let Uc denote the certainly equivalence control law based on any one of 
the approaches presented in Section 7.4. Let 

Cd{ep) = det\Se{9j,)\ 
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Figure 7.6 The time response of the output y{t), control input u(t) and 
estimate b(t) for the switched-excitation approach. 



where Se{Op) denotes the Sylvester matrix of the estimated polynomials 
Rp{s,t) Qmis), Zp(s,t) and 6p(t) is the vector with the plant parameter 
estimates. 

Following the scalar example, we propose the modified control law 



ucit) i{te[0,ti)[j(tk + jkT,tk+i) 

Ur{t) if t e [tk,tk+ jkA 



(7.6.18) 
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Adaptive Law 

ep = P£ct>, ep{o) = eo (7.6.19) 

^ = - . T; ,T^ ' po =Po = Po^>o 

1 + M ' 

where 

e = (z-0j0)/(l + /3o<^T,^) 

and ^0 is chosen so that Cd{9o) > 0. Furthermore, 

P(0) = P(ifc) = P(tfc + iT) = k^^I, j = l,2,...,jk (7.6.20) 

where ko = constant > 0, and 

Jl if te [0,tl)U(tfc+JfcT,tfc+l) r7R9n 

where 

• A; = 1,2,... 

• ti is the first time instant for which Cfi{Op{ti)) = i^(l) > 0, where 

Kfc) = ^ = ^, k = l,2,... (7.6.22) 

• tk {k > 2) is the first time instant after t = ifc_i + Jk-iT for which 

C,(^p(tfc)) = Kfc + E iO = ,^^'li-i ., (7-6.23) 

and jfc = 1,2,... is the smallest integer for which 

k 

CdiOpitk + jkT)) > y{k + Y.n) (7.6.24) 

where r > is a design constant. 

• Uc{t) is the certainty equivalence control given in Section 7.4. 

• Ur{t) is any bounded stationary signal which is sufficiently rich of order 
2n. For example, one can choose 

n 

Ur{t) = 2_. ^i sinojjt 
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where Aj / 0, i = 1, . . . ,n, and Ui / ujj for i / j. 

From (7.6.18), we see that in the time intervals {tk + jfeT, tfc+i), the sta- 
bihzabihty degree Cd{0p{t)) is above the threshold ^{k + J2i=iJi) and the 
adaptive control system includes a normalized least-squares estimator and 
a pole placement controller. In the time intervals [tk+i,tk+i + jk+ir], the 
control input is equal to an external exciting input Ur{t) and the parameter 
vector estimate Op(t) is generated by an unnormalized least-squares estima- 
tor. 

The switching (at time t = tk) from the pole placement control Uc to the 
external rich signal Ur occurs when the stabilizability degree Cd{Op{t)) of the 
estimated model reaches the threshold i^(fc + l^j=i ji)- We keep applying u = 
Ur during successive time intervals of fixed length r, until time t = t^ + jkT 
for which the condition Cd{6p{tk + JfcT)) > i^ik + Y^i=iji) is satisfied and u 
switches back to the CEC law. The idea behind this approach is that when 
the estimated model is stabilizable, the control objective is pole placement 
and closed-loop stabilization; but when the estimation starts to deteriorate, 
the control priority becomes the "improvement" of the quality of estimation, 
so that the estimated parameters can cross the hypersurfaces that contain 
the points where Cd{Op) is close to zero. 

The following theorem establishes the stability properties of the proposed 
adaptive pole placement scheme. 

Theorem 7.6.1 All the signals in the closed-loop (7.3.1) and (7.6.18) to 
(7.6.24) ^'^fi bounded and the tracking error converges to zero as t -^ cx). 
Furthermore, there exist finite constants v* ,T* > such that for t > T* , we 
have CdiOpit)) > u* and u(t) = Uc. 

The proof of Theorem 7.6.1 is rather long and can be found in [63]. 

The design of the switching logic in the above modified controllers is 
based on a simple and intuitive idea that when the quality of parameter es- 
timation is "poor," the objective changes from pole placement to parameter 
identification. Parameter identification is aided by an external open-loop 
sufficiently rich signal that is kept on until the quality of the parameter es- 
timates is acceptable for control design purposes. One of the advantages of 
the switched-excitation algorithm is that it is intuitive and easy to imple- 
ment. It may suffer, however, from the same drawbacks as other switching 
algorithms, that is, the transient performance may be poor during switching. 
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The adaptive control scheme (7.6.18) to (7.6.24) may be simphfied when a 
lower bound v* > for Cd{Op) is known. In this case, y{k) = v* \/k. In the 
proposed scheme, the sequence z>(fc) converges to v* and therefore the lower 
bound for Cd{0*) is also identified. The idea behind the identification of v* 
is due to [189] where very similar to the switched-excitation approach meth- 
ods are used to solve the stabilizability problem of APPC for discrete-time 
plants. 



7.7 Stability Proofs 

In this section we present all the long proofs of the theorems of the previous sub- 
sections. In most cases, these proofs follow directly from those already presented 
for the simple examples and are repeated for the sake of completeness. 

7.7.1 Proof of Theorem 7.4.1 

Step 1. Let us start by establishing the expressions (7.4.24). We rewrite the control 
law (7.4.23) and the normalized estimation error as 

LQmjUp = -P-{yp-ym) (7-7.1) 

em^ = z- 9p(f) = Rp-j—Vp - Zp—Up (7.7.2) 

i\p i\p 

where A(s), Ap(s) are monic, Hurwitz polynomials of degree n+g—l, n, respectively, 
Rp = s"+6j an-i{s), Zp = Oj an-i{s). From Table 7.4, we have A(s) = Ap{s)Aq{s), 
where Aq(s) is a monic Hurwitz polynomial of degree q—l. This choice of A simplifies 
the proof. We should point out that the same analysis can also be carried out with 
A, Ap being Hurwitz but otherwise arbitrary, at the expense of some additional 
algebra. 

Let us define 

A 1 A 1 

W/ = jUp^ Vf = jVp 

and write (7.7.1), (7.7.2) as 

Pyf + LQmUf = ymi, RpA-^yf - ZpAgUf = erri^ (7.7.3) 

where j/„ji = Pj^ym G Coo- By expressing the polynomials Rp{s)Aq[s), Zp{s)Aq{s), 
P{s), L{s)Qm{s) as 

Rpis)Aqis) = s"+«-i + eja„+q.2is), Zp{s)Aqis) = ^Ja„+,_2(s) 
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P{s) = ^05"+"^"' + p^«„+,-2(s), L(s)0™(s) = s"+«-^ + ra„+,_2(s) 
we can rewrite (7.7.3) in the form of 

^(n+q^l) = (^p^()^_p^'^ an+q^2{3)yf - {Pq62 + 1)^ an+q-2{s)Uf (7.7.4) 

-poem^ + ymi 
where the second equation is obtained from (7.7.3) by substituting for yP "^ 
Defining the state a; = h/\" "^ , . . . ,yf,yf,ur "^ ,...,«/,«/ , we obtain 



X = A{t)x + bi{t)em'^ + b2ymi 



(7.7.5) 



where 



A{t)- 




OJ 



o 



{n+q~2)x{n+q-l) 



-poOj - V 



(ri+9-2)x(n+q-l) 



/, 



n+q-2 



lit)- 



1 




"0" 










-Po 


,b2 = 


1 















_0_ 



0(n+q-2)x{n+q-i) is an (n + g — 2) by (n + </ — 1) matrix with all elements equal 
to zero. Now, because Up = Auf = uV' '* + X^ an+q~2{s)uf , yp = Ayf = 

yy "^ + A^a„_|_g„2(s)?// where A is the coefficient vector of A(s) — s""*""^"^, we 
have 

Up = [0,...,0,1,0, ...,0]i;+ [0,...,0, A^]x 

n-\-q—l n-\-q-~l n+g — 1 

yp = [l,0,...,0,0,...,0]i;+[A^,0,...^]a; (7.7.6) 

n+g — 1 n+Q— 1 n+Q— 1 

Step 2. Establish the e.s. of the homogeneous part of (7.7.5). Because P,L 
satisfy the Diophantine equation (7.4.21), we can show that for each frozen time^ t. 



det(s/ - A{t)) = Rp Ag- LQm + P ■ ZpAq = A* Aq 



(7.7.7) 



X ■ Y denotes the algebraic product of two polynomials that may have time-varying 
coefficients. 
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i.e., A{t) is a stable matrix for each frozen time t. One way to verify (7.7.7) is to 
consider (7.7.3) with the coefficients of Rp, Zp, P, L frozen at each time t. It follows 
from (7.7.3) that 

Vf = ^-T fz: , A A ■ {LQmem'^ + ZpAqy^i) 

whose state space realization is given by (7.7.5). Because 

RpAq ■ LQ.m + P ■ ZpKq = A*Kq 

(7.7.7) follows. 

We now need to show that ||^(i)|| G £27 11^(011 G £00 from the properties 
^p G £00 and 6p G C2 which are guaranteed by the adaptive law of Table 7.4. Using 
the assumption that the polynomials RpQm and Zp are strongly coprime at each 
time t, we conclude that the Sylvester matrix Si (defined in Table 7.4) is uniformly 
nonsingular, i.e., |det(S'i)| > 1^0 for some i/^ > Q, and thus 6p G Ceo implies that 
Si,Sf G Coo- Therefore, the solution /3; of the algebraic equation Si$i = O!;* which 
can be expressed as 

Pi = Sj^^a^ 

is u.b. On the other hand, because 6p G £00 and 6p G C2, it follows from the 
definition of the Sylvester matrix that ||S'/(i)|| G £2- Noting that 

/3; = -Sj^^SiSj^^a'^ 

we have /3; G £2 which is implied by §1, Sj^^ G £00 and ||S'/(t)|| G £2- 

Because the vectors 9i,62,p,l are linear combinations of 6p, Pi and all elements 
in A{t) are uniformly bounded, we have 

\\A{t)\\<c{\'m\ + Km 

which implies that ||^(i)|| G £2- Using Theorem 3.4.11, it follows that the homo- 
geneous part of (7.7.5) is e.s. 

Step 3. Use the properties of the C25 norm and B-G Lemma to establish 
boundedness. As before, for clarity of presentation, we denote the C2S norm as || • ||, 
then from Lemma 3.3.3 and (7.7.5) we have 

Ikll < cllem^ll +c, \x{t)\ < cWem^W + c (7.7.8) 



A 

(7.7.8) and Lemma 3.3.2 that (f),m < rrif and 



for some S > 0. Defining m?- = 1 + WypW^ + ||wp|P, it follows from (7.7.5), (7.7.6), 



mi < c+c||a;r + c||em^|r < c||emm/||^ + c (7.7.9) 
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} <c + c e~^'^'~^h^{T)m^{T)m'j{T)dT 



Because em G C2, guaranteed by the adaptive law, the boundedness of nif can be 
estabhshed by applying the B-G Lemma. The boundedness of the rest of the signals 
follows from nif G C^o and the properties of the C2S norm that is used to show that 
mf bounds most of the signals from above. 

Step 4. Establish that the tracking error converges to zero. The tracking 
properties of the APPC scheme are established by manipulating (7.7.1) and (7.7.2) 
as follows: From the normalized estimation error equation we have 

em = Rpj—Vp - Zp — Up 



Filtering each side of the above equation with LQm ^ where L(s, t) = s" ^~^ct^^2{^)^ 
and lc= [1, l^]^ is the coefficient vector of L{s, t), it follows that 

LQm — iem^) = LQm-r- iRp-r-Vp- Zp—Upj (7.7.10) 

Noting that A = A^Ap, and applying the Swapping Lemma A.l, we obtain the 
following equations: 

_i?^_y^ = 7?^_y^ + ,,, ^i^Zp-Upj=Zp—Up + r2 (7.7.11) 

where 

ri = W,,{s) (^(w,,{s)^^^yp^ 9^^ , r^ = W,,{s) (^(w,,{s)^^^Up^ 6, 

and Wci,Wbi are as defined in Swapping Lemma A.l with W = H^^. Because 

Up, Up e £00 and 6a, 61, G L2, it follows that ri,r2 G £2- Using (7.7.11) in (7.7.10), 
we have 

/ ^,, 2\ f ( T-) ^" 



LQ„i — {em ) = L I Rp—j-Vp - Zp—Up + ri - r2 1 (7.7.12) 

Noting that QmUp = Qm{ei + ym) = QmCi, we can write (7.7.12) as 

LQ„r — {em'^) = L f -Rp— ^ei + ri - r2 j - L iZp^Upj (7.7.13) 
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Applying the Swapping Lemma A. 4 (i) to the second term in the right-hand side of 
(7.7.13), we have 

L (Zp^up) = Zp {L{s,t)^up^ +rs (7.7.14) 

(by taking ^^Up = / in Lemma A. 4 (i)), where Zp = a^_i{s)9i, and 

^3 = OlJ^-2F{hOb)a7i-2{s)-rr\Up 

A(s) 
where ||_F(/, (?t)|| < ci\l\ + C2\0h\ for some constants Ci,C2 > 0. Because 

L{s,t)Qrn{s) = L{s,t) ■ Qm{s) 

we use the control law (7.7.1) to write 

L{s,t)^^up = L{s,t) ■ -^^up = -P — ei (7.7.15) 

Substituting (7.7.15) in (7.7.14) and then in (7.7.13), we obtain 



LQ^^iem') = L (^i?p-^eij + Zp [P^^f-ij + Hri - r^) - r^ (7.7.16) 

According to Swapping Lemma A. 4 (ii) (with / = -^ei and Ao(s) = 1), we can 
write 

^i ^pTT^^i] = L{s,t) ■ Rp{s,t)Qm{s)——-ei + r4 
\ A(s) J A(s) 

1 



where 



^p[PX(7f^) = Zp{s,t)-P{s,t)—e, + r, (7.7.17) 



r4 = Q:^_i(s)G(s,ei,;,6'a), rg = a^_i(s)G''(.s, ei, 0b,p) (7.7.18) 



and G{s,ei,l,6a),G (s,ei,0f,,p) are defined in the Swapping Lemma A. 4 (ii). Be- 
cause ei G >Coo and I, p, 6a, Of, e £21 it follows from the definition of G,G that 
G,G' e £2- Using (7.7.17) in (7.7.16) we have 

LQjn-7-{em'^)= iL{s,t) ■ Rp{s,t)Qm{s) + Zp ■ P{s,t)\ --7—ei + L{ri-r2)-rz+r4r[-r^ 

(7.7.19) 
In the above equations, we use X{s, t) to denote the swapped polynomial of X{s, t), 
i.e., 

X(s, t) = pjit)a„is), Xis, t) = al{s)p^{t) 
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Because 

L{s, t) ■ Rp{s, t)Qm{s) + Zp{s, t) ■ P{s, t) = A*{s) 

we have 

L{s,t) ■ Rp{s,t)Qm{s) + Zp{s,t) ■ P{s,t) = A*{s) = A*{s) 

where the second equality holds because the coefficients of A*{s) are constant. 
Therefore, (7.7.19) can be written as 



« = ^" ("-^"j 



where 



V = li Q,n (em^) - ri + r2 ) + ra - r4 - r5 

V Ag(s) 



Because L{s) = a^_i{s)lc, Ic = [1;' ] we have 



V = a^_i(s)/c[-r^(em^) - ri + r2] + Vs - r4 - r^ 



Therefore, it follows from (7.7.20) that 



where 






^° = -J^Ml~ii-'^)^c{r2 - ri) + aZ-2{s)vi - al_^{s)v2] 



vi = F{l,0b)an-2{s) " , Up 



V2 = G{s,ei,l,ea) + G {s,ei,p,0b) 



Because — aAs) — ' °" ^a/sI ^^^ strictly proper and stable, Ic G Coo, and 

'i'i,'''2,vi, V2 G C2, it follows from Corollary 3.3.1 that vq G C2 and vo{t) ^ as 

t —> (X). 

Applying the Swapping Lemma A.l to the first term on the right side of (7.7.21) 
we have 

ei = l^ A*(s)A (s) ^'^^ ' Wc{s){Wb{s){em ))k + vq 
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where Wc{s),Wb{s) have strictly proper stable elements. Because ""^^^"' is 

proper, Zc, <^'m G £00 f] ^2 and vq G £00 H ^2, it follows that ei G £00 f] ^2- 

The plant equation j/p = W^Up assumes a minimal state space representation of 
the form 

Y = AY + Bup 

Vp = C^Y 

where (C, A) is observable due to the coprimeness of Zp, Rp. Using output injection 
we have 

Y ={A- KC^)Y + Bup + Kyp 

where K is chosen so that Aco = A — KC^ is a stable matrix. Because yp,Up G Coo 
and Aco is stable, we have Y G Cqo, which implies that Y, ijp G Coo- Therefore, 
^i = Vp — y-m & Coot which, together with ei G £2 and Lemma 3.2.5, implies that 
ei{i) ^ as i — > c». 

7.7.2 Proof of Theorem 7.4.2 

Step 1. Develop the closed-loop state error equations. We start by representing 
the tracking error equation 

ZpQi 

ei = „ „ Mn 



JXp^n 



in the following state-space form 



/, 



n+q—l 



/2 Ltp 



, eG7e"+« 



(7.7.22) 



ei = C"^e 

where C^ = [1, 0, . . . , 0] G T^""*"' and 91, 62 are the coefficient vectors of RpQm — 
s"+*,ZpQi, respectively. 

Let 60 = e — e be the state observation error. Then from the equation for e in 
Table 7.5 and (7.7.22), we have 



Ac{t)e + koC^eo 
AoCo + Oiei - 92Up 



(7.7.23) 



where 



A 



/, 



n+q—1 
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is a stable matrix; Ac{t) = A — BKc and di = 6i — 61,02 = O2 — 02- The plant input 
and output satisfy 

Vp = C^eo + C^e + ym 

Up = \, "P+ ^. Vp (7.7.24) 

where X{s),Y{s) are polynomials of degree n + q—l that satisfy (7.3.25) and A*{s) 
is a Hurwitz polynomial of degree 2{n+q) — 1. Equation (7.7.24) for Up is established 
in the proof of Theorem 7.3.1 and is used here without proof. 

Step 2. Establish e.s. for the homogeneous part of (7.7.23). Let us first 
examine the stability properties of Ac{t) in (7.7.23). For each frozen time t, we 
have 

det(s/ - Ac) = det(s J - i + BKc) = A^ (s) (7.7.25) 

i.e., Ac{t) is stable at each frozen time t. If Zp{s,t)Qi{s), Rp{s,t)Qjn{s) are strongly 
coprime, i.e., {A, B) is strongly controllable at each time t, then the controller gains 
Kc may be calculated at each time t using Ackermann's formula [95], i.e., 

kc = [o,o,...,o,i]gc'A:{A) 

where 

gc=[B,AB,...,A^+'^-'B] 

is the controllability matrix of the pair {A,B). Because {A, B) is assumed to be 
strongly controllable and A, B £ Coo due to 9p G C^o, we have Kc G 'Coo. Now, 

^c = [0, 0, . . . , 0, 1] ^-g-^gcg-'A*c{A) + g-^^^AHA) 

Because 6p G C^o and Op G C2, it follows that ||_?i'c(i)|| G C2, which, in turn, implies 
that ||Ac(t)|| G £2- From Ac being pointwise stable and ||ylc(^)|| G ^2, we have that 
Ac{t) is a u.a.s matrix by applying Theorem 3.4.11. If Zp{s,t)Qi{s),Rp{s,t)Qm{s) 
are not strongly coprime but Zp{s,t), Rp{s,t)Qm{s) are, the boundedness of Kc 

and ||_ftrc(^)|| G ^2 can still be established by decomposing {A, B) into the strongly 
controllable and the stable uncontrollable or weakly controllable parts and using 
the results in [95] to obtain an expression for Kc. Because Aq is a stable matrix the 
homogeneous part of (7.7.23) is e.s. 

Step 3. Use the properties of the C25 norm and the B-G Lemma to establish 
boundedness. As in Example 7.4.2., we apply Lemmas 3.3.3, 3.3.2 to (7.7.23) and 
(7.7.24), respectively, to obtain 

Pll < cllC^eoll 
hpW < c||C^eo||+c||e|| + c<c||C^eo||+c (7.7.26) 

\\up\\ < c||e||+c||yp||<c||CTeo||+c 
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where || • || denotes the C2S norm for some 6 > 0. 

We relate the term C^Bq with the estimation error by using (7.7.23) to express 
(_/ Gq as 

C^Co = C^{sl - A,)-\eiei - e2Up) (7.7.27) 

Noting that (C, A^) is in the observer canonical form, i.e., C^ {si — Ag)^^ = 



hiSi- 02iUp), n= n+ q- I 



where di = [6ii,0i2T . . ,Oin]^ ,i = 1,2. Applying Swapping Lemma A.l to each 
term under the summation, we have 

"""' Oue^ = ^"^t^'}'^ fe , '"'\ , ei + W,,{s) {WUs)ei) k 



a„ + ,_i(s) 


, we have 




Al{s) 






C^eo-- 


~ ' ■' A* 



A*^{s) Al[s) V ^'Ap(s)Qi(s) 

and 

Ap(s)Qi(s) 



2i"P = 1m~\ ^2jT— r— ^— r-Up + W ci{s) (y/bi{s)Up) B^i 



Al{s) ' Al{s) V ^'Ap(s)Qi(s) 

where Wci,Wbi,i = 0, . . . ,n + q — 1 are transfer matrices defined in Lemma A.l 
with VK(s) = . f s„ , y Therefore, C^Gq can be expressed as 

^ Ap{s)Q,{s) ^ f- s^-' s^'^ _ \ , 

A*o{s) ^ V Ap(s)Qi(s) Ap(s)Qi(s) 7 

Ap(.)Qi(.) (,-r «n+,-i(«) ^^ _ ~^j ar.^,M \ ^ ^^ ^^^^28) 



A*(s) V ' Ap(s)Qi(s) 2 Ap(s)Qi(s) 

where 

ri = ^''^'^!^^!^''^ yW,,{s)[{Wu{s)e{}hu- {Wb^{s)up)k^] 

From the definition of 6i , we have 

6jan+q-l{s) = 6jan+q-l{s) - Of^ an+q^l{s) 

= Rp{s, t)Q^{s) - s"+9 - Rp{s)Q^{s) + 5"+-? 

= {Rp{s,t)-Rp{s))Qm{s) = eJa„^i{s)Qm{s) (7.7.29) 

where Oa = Oa — 0*^ is the parameter error. Similarly, 

^7a„+,_i(s) = ej an-i{s)Qi{s) (7.7.30) 
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where eb = db-0;. Using (7.7.29) and (7.7.30) in (7.7.28), we obtain 
>T„ _ Ap(s)Qi(s) /^2T„, /„^'9m(s) 1 ^ 5T„, /„^ 1 



A*{s) V Qi(s) ^p[s) Ap(s) y 

Ap(s)Qi(s) /--r , . Qm(s) -T , , Qm{s) \ 

A*(s) V Oi(s)Ap(s) '^ Ap{s)Qi{s) ' ) 

+ri (7.7.31) 

where the second equaUty is obtained using 

Qm(s)ei = Qm{s)yp, Ql{s)Up = Qm{s)Up 

Noting that 

"«-i(s)— — -Up = (^1, Q!„_i(s)— — -yp = -02 

Ap(s) Ap(s) 

we use Swapping Lemma A.l to obtain the following equalities: 

where Wcq^ W^q are as defined in Swapping Lemma A.l with M^(s) = qj-! ■ Using 
the above equalities in (7.7.31) we obtain 

C^eo = _ ^P(2?T^'^ ^7^ + ^2 (7.7.32) 

where 

r2 = n+ ^''^'l'^'}'^ (W,q{s) {Wbq{s)<l>J) k + W,q{s) {W^qi^S^J) 6 a) 

Prom Table 7.5, the normalized estimation error satisfies the equation 
which can be used in (7.7.32) to yield 

-p Ap(s)(5m(s) 2 , 1^ ry oo\ 

C Co = , , , em + r2 (7.7.33) 

From the definition of m'i = 1 + HwpP + ||2/p|P and Lemma 3.3.2 , we can show 
that rrif is a normalizing signal in the sense that (jy/mf^Tn/nif G £00 for some 
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5 > 0. From the expression of ri, r2 and the normalizing properties of nif, we use 
Lemma 3.3.2 in (7.7.33) and obtain 

llC^eoll < c\\emmf\\ + c||(?pm/|| (7.7.34) 



Using (7.7.34) in (7.7.26) and in the definition of rrif, we have the following inequal- 
ity: 

or 

,2 



rnj < c||emm/|p + ||^pTO/|P + c 



rrif < c\\gmf\\ + c 



A 



where g = em + \6p\ and g G £21 to which we can apply the B-G Lemma to 
show that mf G Ceo ■ From mf G Ceo and the properties of the C2S norm we can 
establish boundedness for the rest of the signals. 

Step 4. Convergence of the tracking error to zero. The convergence of the 
tracking error to zero can be proved using the following arguments: Because all 
signals are bounded, we can establish that -^(em^) G C^o, which, together with 
tm? G C2, implies that e{t)ra^[t) — > 0, and, therefore, 6p{t) — > as i — > 00. From 
the expressions of ri,r2 we can conclude, using Corollary 3.3.1, that r2 G C2 and 
^2(0 ^ as i ^ 00. From (7.7.33), i.e., 

C eo= ., . em + r2 

and em^,r2 G C2 and r2 ^ as t ^ c», it follows from Corollary 3.3.1 that 
|C^eo| G C2 and |C^eo(t)| ^ as t ^ c». Because, from (7.7.23), we have 

'e = AS)e + KoC^eo 



it follows from the u.a.s property oi Ac{t) and the fact that |C^eo| G C2, \C^ e^] -^ 
as i — > 00 that e — > as f — > c». From ei = yp — y^ = C^ Co + C^e (see (7.7.24)), 
we conclude that ei(i) — > as t — > c» and the proof is complete. 

7.7.3 Proof of Theorem 7.5.1 

We present the stability proof for the hybrid scheme of Table 7.9. The proof of 
stability for the schemes in Tables 7.8 and 7.10 follows using very similar tools and 
arguments and is omitted. 

First, we establish the properties of the hybrid adaptive law using the following 
lemma. 

Lemma 7.7.1 Let 0ii^,62k, Kok, K^k be as defined in Table 1.9 and Qpk as defined 
in Table 7.7. The hybrid adaptive law of Table 7.7 guarantees the following: 
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(i) Opk e £00 and A0pk G ^2, e?7i e £2 
(ii) Oik, 02k, K ok e ^00 and AOik,A02k G ^2 
where Axk = Xk+i — Xk; k = 0,1,2, .. . 
(iii) If Rp{s,tk)Qm{s),Zp{s,tk) are strongly coprime for each fc = 0,1,..., then 



n+q 



Proof The proof for (i) is given in Section 4.6. 

By definition, Oik, 02k are the coefficient vectors of Rp{s,tk)Qm{s) 
Zp{s,tk)Qi{s) respectively, where Rpls,tk) = s"-+ Oj^n_i{s), Zj(s,tk) =Oj^n-iis)- 
We can write 

Oik = FlOak , 02k = FlObk 

where Fi,F2 G 7^("+9)x" are constant matrices which depend only on the coef- 
ficients of Qi{s),Qm{s), respectively. Therefore, the properties Oik, 02k G i'oo and 
AOik, A02fe ^ ^2 follow directly from (i). Because Kok = a* — Oik, we have K^k G ^oo 
and the proof of (ii) is complete. 

Part (iii) is a direct result of linear system theory. □ 

Lemma 7.5.1 indicates that the hybrid adaptive law given in Table 7.7 has 
essentially the same properties as its continuous counterpart. We use Lemma 7.7.1 
to prove Theorem 7.5.1 for the adaptive law given in Table 7.9. 

As in the continuous time case, the proof is completed in four steps as follows: 

Step 1. Develop the state error equation for the closed-loop APPC scheme. Be- 
cause the controller is unchanged for the hybrid adaptive scheme, we follow exactly 
the same steps as in the proof of Theorem 7.4.2 to obtain the error equations 

'e = Ack{t)e + kok{t)C^eo 

So = Aoeo + Oik{t)ei- 02kUp 

Vp = C^Co + C^e + y^ (7.7.35) 

Up = Wi{s)k^k{t)e+W2{s)yp 

Up = -kck{t)e 

where Ack, Kok, Kck,0ik,02k are as defined in Section 7.4.3 with 6b{t),0a{t) re- 
placed by their discrete versions Oi,k,Oak respectively, i.e., K^k = a* — Oik and K^k 
is solved from det{sl — Ak + BkKck) = A*^{s); A^ is a constant stable matrix, 
Ack = Ak — BkKck and Wi{s), W2{s) are proper stable transfer functions. Further- 
more, Ack{t), Kck{t), Kok{t),0ik{t),02k{t) are piecewise constant functions defined 
asfkit) = fk,^te[kT„ik+l)T,). 
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Step 2. Establish e.s. for the homogeneous part of (7.7.35). Consider the 
system 

z = AkZ, z{to) = zo (7.7.36) 



where 



Mt) 



Ack{t) Kok{t)C^ 
Ao 



te [kTs,{k + i)T, 



Because A9ik, A92k G ^2 and {Ak,Bk) is strongly controllable, one can verify 
that AKok, AKck £ ^2 and thus AAck, AAk G £2- Therefore, for any given small 
number /i > 0, we can find an integer iV^ such that^ 



iA'u 



<fi, Vfc > N^ 



We write (7.7.36) as 



z = An^z+ {Ak - AnJz, \/t > N^T, 



(7.7.37) 



Because Aj\j is a constant matrix that is stable and \\Ak — An \\ < /i, Vfc > N^, we 
can fix ^ to be small enough so that the matrix Ak = Aj^ + {Ak — An ) is stable 
which implies that 

\z{t)\ < cie-"(*-^-^-)|z(7V^r,)|, Wt > N^Ts 
for some constants ci, a > 0. Because 

z{N^Ts) = e^-^^^e^-^--^^ ■ ■ ■ e^^^^e^^^'zo 
and Nfj_ is a fixed integer, we have 

|^(iV^T,)|<C2e-"(^-^-*")|zo| 
for some constant C2 > 0. Therefore, 

|z(t)|<ciC2e^"(*-*")|zo|, ^t>N^T, (7.7.38) 



where ci, C2, a are independent of to, zq. 

On the other hand, for t G [Iq, N^Ts), we have 



z{t) = e^^(*-^^=)e^'-^» 



,gA,T.gA„T.^^ 



(7.7.39) 



^If a sequence {/*} satisfies Afk £ £2, then lim„^oo X^^ ll^/i|| — Oi which implies 
that for every given /i > 0, there exists an integer A^^ that depends on fi such that 

Etiv, 11^/' II < M, Vfc > iV^. Therefore, \\f, - f^J = \\EIn^ A/,|| < J^lj,^ W^M < 
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where i is the largest integer that satisfies i < ijr and i < N^. Because A^^ is a 
fixed integer, it follows from (7.7.39) that 

W)\ < c;|zo| < C3e-"(*-*'>)|zo|, Vi e [h.N^T,) (7.7.40) 



(7.7.38) and (7.7.40), we have 



for some constant c^ and c^ = Cge"^''"^", which is independent of ^Qj ^o- Combining 



|2(i)|<ce-"(*-*")|z(io)|, Vt>io 

for some constants c, a > which are independent of ^Oi^o s-^id therefore (7.7.36), 
the homogeneous part of (7.7.35), is e.s. 

Step 3. Use the properties of the C2S norm and B-G Lemma to establish signal 
boundedness. Following exactly the same procedure as in the proof of Theorem 7.4.2 
presented in Section 7.7.2 for Step 3 of the continuous APPC, we can derive 

\\mff<c+c\\C^eof 

where || • || denotes the C2S norm, and 

C^eo = C^{sl - Ao)-\eikei - e^kUp) (7.7.41) 

Because A6ak, AObk& h, according to Lemma 5.3.1, there exist vectors Oa{t), 0b{t) 
whose elements are continuous functions of time such that \9ak{t) — 0a{t)\ G ^2, 
\()bk{t) ~ ^b{t)\ G ^2 and 6a{i),0b{i) G £2- Let ^1,^2 be the vectors calculated from 
Table 7.9 by replacing 6ak, &bk with 6a, 0b respectively. As we have shown in the 
proof of Theorem 7.4.2, 81,62 depend linearly on 6a, db- Therefore, given the fact 

that Oa, k, \0a - Oak\, \0b " Obk\ G C2, we have 61,62, |^i - 6ik\, |^2 - ^2fc| G C2. 
Thus, we can write (7.7.41) as 

C^Co = C^[sl - Ao)-\hei - hup + e) (7.7.42) 

where e = {6ik{t) — 6i{i))ei — {d2k{i) — 02{t))up. Now, 61, 62 have exactly the same 
properties as 61,62 in equation (7.7.27). Therefore, we can follow exactly the same 
procedure given in subsection 7.7.2 (from equation (7.7.27) to (7.7.33)) with the 
following minor changes: 

• Replace 61,62 by 61,62 

• Replace 6a, 6b by 6a, 6,, 

• Add an additional term C^ [si — Ao)~^e in all equations for C^ e^, 

• In the final stage of Step 3, to relate 6a<t'2 — ^J 4'i with erri^ , we write 

where 62 = [da - 6akV(t>2 - [db - hkV (j^i, i-e.. 



em2 = Fa„^2 - Oj.^i = Oj<f>2 - 6j4>, 



62 
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At the end of this step, we derive the inequaUty 

m'j < cWgnifW'^ + c 

where g"^ = e^m^ + |^pp + {Opk - dp\'^, Op = [OjJJ]'^, and g e £2- The rest of the 
proof is then identical to that of Theorem 7.4.2. 

Step 4. Establish tracking error converges to zero. This is completed by fol- 
lowing the same procedure as in the continuous case and is omitted here. □ 



7.8 Problems 

7.1 Consider the regulation problem for the first order plant 

X = ax -\- hu 
y = x 

(a) Assume a and b are known and 6 7^ 0. Design a controller using pole 

placement such that the closed- loop pole is located at —5. 

(b) Repeat (a) using LQ control. Determine the value of A in the cost 

function so that the closed- loop system has a pole at —5. 

(c) Repeat (a) when a is known but b is unknown. 

(d) Repeat (a) when b is known but a is unknown. 

7.2 For the LQ control problem, the closed-loop poles can be determined from 

G{s) = Zp{s)/ Rp{s) (the open-loop transfer function) and A > (the weight- 
ing of the plant input in the quadratic cost function) as follows: Define 

F(s) = Rp{s)Rp{-s) + \-'^Zp{s)Zp{-s). Because F{s) = F{-s), it can 
be factorized as 

F{s) = {s + Pl){s + P2) ■ ■■ {s + Pn){-S + Pl){-S + P2) ■ --{-S+Pn) 

where pi > 0. Then, the closed-loop poles of the LQ control are equal to 

Pl,P2,---,Pn- 

(a) Using this property, give a procedure for designing an ALQC without 

having to solve a Riccati equation. 

(b) What are the advantages and disadvantages of this procedure compared 

with that of the standard ALQC described in Section 7.4.3? 

7.3 Consider the speed control system given in Problem 6.2, where a,b,d are as- 

sumed unknown. 
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(a) Design an APPC law to achieve the following performance specifications: 

(i) The time constant of the closed-loop system is less than 2 sec. 
(ii) The steady state error is zero for any constant disturbance d 

(b) Design an ALQC law such that 



Jo 

is minimized. Simulate the closed-loop ALQC system with a = 0.02, b : 
1.3, rf = 0.5 for different values of A. Comment on your results. 

7.4 Consider the following system: 



y 



e2 _L ')<:,,, a _L ,,i2 



2^UJnS + Lol 



where the parameter a;„ (the natural frequency) is known, but the damping 
ratio ^ is unknown. The performance specifications for the closed-loop system 
are given in terms of the unit step response as follows: (a) the peak overshoot 
is less than 5% and (b) the settling time is less than 2 sec. 

(a) Design an estimation scheme to estimate ^ when aj„ is known. 

(b) Design an indirect APPC and analyze the stability properties of the 

closed-loop system. 

7.5 Consider the plant 

s + b 

y= --- — zu 
s(s + a) 

(a) Design an adaptive law to generate d and b, the estimate of a and b, 

respectively, on-line. 

(b) Design an APPC scheme to stabilize the plant and regulate y to zero. 

(c) Discuss the stabilizability condition a and b have to satisfy at each time 

t. 

(d) What additional assumptions you need to impose on the parameters a 

and b so that the adaptive algorithm can be modified to guarantee the 
stabilizability condition? Use these assumptions to propose a modified 
APPC scheme. 

7.6 Repeat Problem 7.3 using a hybrid APPC scheme. 

7.7 Solve the MRAC problem given by Problem 6.10 in Chapter 6 using Remark 

7.3.1 and an APPC scheme. 

7.8 Use Remark 7.3.1 to verify that the MRC law of Section 6.3.2 shown in Figure 

6.1 is a special case of the general PPC law given by equations (7.3.3), (7.3.6). 
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7.9 Establish the stabihty properties of the hybrid ALQ control scheme given in 

Table 7.10. 

7.10 Establish the stability properties of the hybrid APPC scheme of Table 7.8. 

7.11 For n = 2,q= 1, show that A{t) defined in (7.7.5) satisfies det{sl - A{t)) = 
Vq, where A*, Aq 



Chapter 8 

Robust Adaptive Laws 



8.1 Introduction 

The adaptive laws and control schemes developed and analyzed in Chapters 4 
to 7 are based on a plant model that is free of noise, disturbances and 
unmodeled dynamics. These schemes are to be implemented on actual plants 
that most likely deviate from the plant models on which their design is based. 
An actual plant may be infinite dimensional, nonlinear and its measured 
input and output may be corrupted by noise and external disturbances. 
The effect of the discrepancies between the plant model and the actual plant 
on the stability and performance of the schemes of Chapters 4 to 7 may 
not be known until these schemes are implemented on the actual plant. In 
this chapter, we take an intermediate step, and examine the stability and 
robustness of the schemes of Chapters 4 to 7 when applied to more complex 
plant models that include a class of uncertainties and external disturbances 
that are likely to be present in the actual plant. 

The question of how well an adaptive scheme of the class developed in 
Chapters 4 to 7 performs in the presence of plant model uncertainties and 
bounded disturbances was raised in the late 1970s. It was shown, using 
simple examples, that an adaptive scheme designed for a disturbance free 
plant model may go unstable in the presence of small disturbances [48]. 
These examples demonstrated that the adaptive schemes of Chapters 4 to 
7 are not robust with respect to external disturbances. This nonrobust 
behavior of adaptive schemes became a controversial issue in the early 1980s 

530 
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when more examples of instabilities were published demonstrating lack of 
robustness in the presence of unmodeled dynamics or bounded disturbances 
[85, 197]. This motivated many researchers to study the mechanisms of 
instabilities and find ways to counteract them. By the mid-1980s, several 
new designs and modifications were proposed and analyzed leading to a body 
of work known as robust adaptive control. 

The purpose of this chapter is to analyze various instability mechanisms 
that may arise when the schemes of Chapters 4 to 7 are applied to plant 
models with uncertainties and propose ways to counteract them. 

We start with Section 8.2 where we characterize various plant model un- 
certainties to be used for testing the stability and robustness of the schemes 
of Chapters 4 to 7. In Section 8.3, we analyze several instability mechanisms 
exhibited by the schemes of Chapters 4 to 7, in the presence of external dis- 
turbances or unmodeled dynamics. The understanding of these instability 
phenomena helps the reader understand the various modifications presented 
in the rest of the chapter. In Section 8.4, we use several techniques to modify 
the adaptive schemes of Section 8.3 and establish robustness with respect to 
bounded disturbances and unmodeled dynamics. The examples presented in 
Sections 8.3 and 8.4 demonstrate that the cause of the nonrobust behavior 
of the adaptive schemes is the adaptive law that makes the closed- loop plant 
nonlinear and time varying. The remaining sections are devoted to the devel- 
opment of adaptive laws that are robust with respect to a wide class of plant 
model uncertainties. We refer to them as robust adaptive laws. These robust 
adaptive laws are combined with control laws to generate robust adaptive 
control schemes in Chapter 9. 

8.2 Plant Uncertainties and Robust Control 

The first task of a control engineer in designing a control system is to obtain 
a mathematical model that describes the actual plant to be controlled. The 
actual plant, however, may be too complex and its dynamics may not be 
completely understood. Developing a mathematical model that describes 
accurately the physical behavior of the plant over an operating range is a 
challenging task. Even if a detailed mathematical model of the plant is 
available, such a model may be of high order leading to a complex controller 
whose implementation may be costly and whose operation may not be well 
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understood. This makes the modehng task even more challenging because 
the mathematical model of the plant is required to describe accurately the 
plant as well as be simple enough from the control design point of view. 
While a simple model leads to a simpler control design, such a design must 
possess a sufficient degree of robustness with respect to the unmodeled plant 
characteristics. To study and improve the robustness properties of control 
designs, we need a characterization of the types of plant uncertainties that 
are likely to be encountered in practice. Once the plant uncertainties are 
characterized in some mathematical form, they can be used to analyze the 
stability and performance properties of controllers designed using simplified 
plant models but applied to plants with uncertainties. 

8.2.1 Unstructured Uncertainties 

Let us start with an example of the frequency response of a stable plant. 
Such a response can be obtained in the form of a Bode diagram by exciting 
the plant with a sinusoidal input at various frequencies and measuring its 
steady state output response. A typical frequency response of an actual 
stable plant with an output y may have the form shown in Figure 8.1. 

It is clear that the data obtained for lu > cOm are unreliable because 
at high frequencies the measurements are corrupted by noise, unmodeled 
high frequency dynamics, etc. For frequencies below Wm, the data are accu- 
rate enough to be used for approximating the plant by a finite-order model. 
An approximate model for the plant, whose frequency response is shown in 
Figure 8.1, is a second-order transfer function Gq(s) with one stable zero 
and two poles, which disregards the phenomena beyond, say uj > cOm- The 
modeling error resulting from inaccuracies in the zero-pole locations and 
high frequency phenomena can be characterized by an upper bound in the 
frequency domain. 

Now let us use the above example to motivate the following relationships 
between the actual transfer function of the plant denoted by G{s) and the 
transfer function of the nominal or modeled part of the plant denoted by 
Go{s). 

Definition 8.2.1 (Additive Perturbations) Suppose thatG{s) andGo^s) 
are related by 

Gis) = Gois) + Aais) (8.2.1) 



31ogj„|>'0ra) 



CO 



(0 



Figure 8.1 An example of a frequency response of a stable plant. 



where Aa(s) is stable. Then Aa{s) is called an additive plant perturbation 
or uncertainty. The structure of Aa{s) is usually unknown but Aa(s) is 



assumed to satisfy an upper bound in the frequency domain, i.e., 

|A„(ja;)| <5aiu;) Vw 



^.2.2) 



for some known function Sa{io). In view of (8.2.1) and (8.2.2) defines a family 
of plants described by 



n„ = {G| \GiJu;)-GoUu^)\<Saiu;)} 



^.2.3) 



The upper bound 5a{uj) of Aa^jui) may be obtained from frequency re- 
sponse experiments. In robust control [231], Go(s) is known exactly and the 
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uncertainties of the zeros and poles of G(s) are included in Aa(s). In adap- 
tive control, the parameters of Gq(s) are unknown and therefore zero-pole 
inaccuracies do not have to be included in Aa(s). Because the main topic 
of the book is adaptive control, we adopt Definition 8.2.1, which requires 
Aci(s) to be stable. 

Definition 8.2.2 (Multiplicative Perturbations) Let G(s),Go{s) be re- 
lated by 

Gis) = Go{s)(l + A„,(s)) (8.2.4) 

where Amis) is stable. Then Amis) is called a multiplicative plant pertur- 
bation or uncertainty. 

In the case of multiplicative plant perturbations. Amis) may be constrained 
to satisfy an upper bound in the frequency domain, i.e., 

\AmiJuj)\ < Smiuj) (8.2.5) 

for some known (5m (w) which may be generated from frequency response 
experiments. Equations (8.2.4) and (8.2.5) describe a family of plants given 

by 

\GiJu;) - GoiJu;)\ 



n™ = G 



1^ .. ^1 <5mi^)\ (8.2.6) 

\Goij^)\ } 

For the same reason as in the additive perturbation case, we adopt Defini- 
tion 8.2.2 which requires Amis) to be stable instead of the usual definition 
in robust control where Amis) is allowed to be unstable for a certain family 
of plants. 

Definition 8.2.3 (Stable Factor Perturbations) Let G(s), Go(s) have 
the following coprime factorizations [231]: 

iVo(g) + Ai(.s) ., iVo(s) 

Dois) + A2(s) Dois) 

where Nq and Dq are proper stable rational transfer functions that are co- 
prime,^ and Ai(s) and A2(s) are stable. Then Ai(s) and A2(s) are called 
stable factor plant perturbations. 



^Two proper transfer functions P{s), Q{s) are coprime if and only if they have no finite 
common zeros in the closed right half s-plane and at least one of them has relative degree 
zero [231]. 
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Figure 8.2 Block diagram representations of plant models with (i) addi- 
tive, (ii) multiplicative, and (iii) stable factor perturbations. 



Figure 8.2 shows a block diagram representation of the three types of plant 
model uncertainties. 

The perturbations Aci(s), Am(s), Ai(s), and A2(s) defined above with 
no additional restrictions are usually referred to as unstructured plant model 
uncertainties. 
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8.2.2 Structured Uncertainties: Singular Perturbations 

In many applications, the plant perturbations may have a special form be- 
cause they may originate from variations of physical parameters or arise 
because of a deliberate reduction in the complexity of a higher order math- 
ematical model of the plant. Such perturbations are usually referred to as 
structured plant model perturbations. 

The knowledge of the structure of plant model uncertainties can be ex- 
ploited in many control problems to achieve better performance and obtain 
less conservative results. 

An important class of structured plant model perturbations that describe 
a wide class of plant dynamic uncertainties, such as fast sensor and actuator 
dynamics, is given by singular perturbation models [106]. 

For a SISO, LTI plant, the following singular perturbation model in the 
state space form 

X = Aux + Ai2Z + Biu, X eTV 
liz = A21X + A22Z + B2U, zen"" (8.2.8) 

y = Cjx + Cjz 

can be used to describe the slow (or dominant) and fast (or parasitic) phe- 
nomena of the plant. The scalar fi represents all the small parameters such 
as small time constants, small masses, etc., to be neglected. In most appli- 
cations, the representation (8.2.8) with a single parameter fi can be achieved 
by proper scaling as shown in [106]. All the matrices in (8.2.8) are assumed 
to be constant and independent of fi. As explained in [106], this assumption 
is for convenience only and leads to a minor loss of generality. 

The two time scale property of (8.2.8) is evident if we use the change of 
variables 

Zf = z + L{n)x (8.2.9) 

where L(fj,) is required to satisfy the algebraic equation 

A21 - A22L + fiLAii - fiLAuL = (8.2.10) 

to transform (8.2.8) into 



X = AgX + A\2Zf + B\u 

^Zf = AfZf + BsU (8.2.11) 

y = Cjx + Cjzf 
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where As = An - A^L, Af = A22 + fJ-LA^, Bs = B2 + fiLBi , Cj = Cj- CJL. 
As shown in [106], if A22 is nonsingular, then for all fi e [0,/i*) and some 
fi* > 0, a solution of the form 

L = A^2^^21 + 0{fl) 

satisfying (8.2.10) exists. It is clear that for u = 0, i.e., 



X = AsX + Ai2Zf 

P'if = AfZf 



(8.2.12) 



the eigenvalues of (8.2.12) are equal to those of As and Aj/fi, which, for 
small fi and for Af nonsingular, are of 0(1) and 0(1/ fi), respectively^. The 
smaller the value of //, the wider the distance between the eigenvalues of As 
and Af/n, and the greater the separation of time scales. It is clear that if 
Af is stable then the smaller the value of /x is, the faster the state variable 
Zf goes to zero. In the limit as /i ^ 0, Zf converges instantaneously, i.e., 
infinitely fast to zero. Thus for small fi, the effect of stable fast dynamics is 
reduced considerably after a very short time. Therefore, when A22 is stable 
(which for small /x implies that Af is stable), a reasonable approximation of 
(8.2.8) is obtained by setting /U = 0, solving for z from the second equation 
of (8.2.8) and substituting for its value in the first equation of (8.2.8), i.e., 

xo = Aqxq + Bqu, xo eW"- .g 2 i^\ 

yo = Cjxo + Dqu 

where ^0 = ^11 - ^i2^^2^^2i, -Bq = ^i - ^12^^2^-62, Cj" = Cj - CJA^^A2i 
and Dq = —C2A22 B2. With /x set to zero, the dimension of the state space 
of (8.2.8) reduces from n + m to n because the differential equation for z in 
(8.2.8) degenerates into the algebraic equation 

= A21X0 + ^22 -zo + B2U 

i.e., 

ZQ = -^^2^^212:0 + B2U) (8.2.14) 



^We say that a function f(x) is 0(|a::|) in P C 7?," if there exists a finite constant c > 
such that |/(a;)| < c\x\ for all x &V where x — Q ^V. 
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where the subscript is used to indicate that the variables belong to the 
system with fj, = 0. The transfer function 

Go{s) = Cj{sI-Ao)-^Bo + Do (8.2.15) 

represents the nominal or slow or dominant part of the plant. 

We should emphasize that even though the transfer function G{s) from u 
to y of the full-order plant given by (8.2.8) is strictly proper, the nominal part 
Go(s) may be biproper because Dq = — C2 ^22 -^2 rnay not be equal to zero. 
The situation where the throughput Dq = — C2 ^22 ^2 induced by the fast 
dynamics is nonzero is referred to as strongly observable parasitics [106]. As 
discussed in [85, 101], if Go{s) is assumed to be equal to Cq {si — Aq)~^Bq 
instead of (8.2.15), the control design based on Gq(s) and applied to the 
full-order plant with /U > may lead to instability. One way to eliminate 
the effect of strongly controllable and strongly observable parasitics is to 
augment (8.2.8) with a low pass filter as follows: We pass y through the 
filter 5^ for some /i, /o > 0, i.e., 

ijf = -foVf + fiy (8.2.16) 

and augment (8.2.8) with (8.2.16) to obtain the system of order (n + 1 + m) 

Xa = AuXa + A12Z + BiU 

HZ = A2lXa + A22Z + B2U (8.2.17) 

y = Cjxa 

where Xa = [yf,x ] and Aii,Ai2,A2i,Bi,Ci are appropriately defined. 
The nominal transfer function of (8.2.17) is now 

Go{s) = Cj{sI-Ao)-'Bo 

which is strictly proper. 

Another convenient representation of (8.2.8) is obtained by using the 
change of variables 

r] = Zf + Aj^BsU (8.2.18) 

i.e., the new state r] represents the difference between the state zj and the 
"quasi steady" state response of (8.2.11) due to /x / obtained by approxi- 
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mating fizf ~ 0. Using (8.2.18), we obtain 

X = AgX + AuT] + BgU 

j_ir] = AfT] + nAj'^Bsii (8.2.19) 

y = Cjx + ^2^7? + DsU 

where Bg = Bi — A12AI Bg, Dg = —CjAl Bg, provided u is differentiable. 
Because for \u\ = 0(1), the slow component of r/ is of 0(/i), i.e., at steady 
state \ri\ = 0{fi), the state t] is referred to as the parasitic state. It is clear 
that for \u\ = 0(1) the effect of ?? on x at steady state is negligible for small 
fi whereas for \u\ > 0{1/ ji), |?7| is of 0(1) at steady state, and its effect on 
the slow state x may be significant. The effect of ii and ry on x is examined 
in later sections in the context of robustness of adaptive systems. 

8.2.3 Examples of Uncertainty Representations 

We illustrate various types of plant uncertainties by the following examples: 

Example 8.2.1 Consider the following equations describing the dynamics of a DC 
motor 

Jlu = kii 

di 
L — = —kyuj — Ri + V 
dt 

where i,v,R and L are the armature current, voltage, resistance, and inductance, 

respectively; J is the moment of inertia; uj is the angular speed; kii and k2'jJ are 

the torque and back e.m.f., respectively. 

Defining x = w, 2; = i we have 

X = boz, fiz = —a^x — OL\z + v 
y=x 

where 69 = fci/ J, 0:2 = ^2, ai = -R and fi = L, which is in the form of the singular 
perturbation model (8.2.8). The transfer function between the input v and the 
output y is given by 

y{s) bo , 

-TT = ^ , = G{s,fis) 

V[S) /iS-^ + QfiS + ag 

where ag = 6o'^2- In most DC motors, the inductance L = /i is small and can be 
neglected leading to the reduced order or nominal plant transfer function 

Gois) = -^ 
ai-s + ao 
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Using Gq{s) as the nominal transfer function, we can express G{s,fis) as 
G{s, fis) = Go{s) + Aa{s, fis), Aa{s, ^is) = -fl- 



{^is^ + ais + ao){ais + ao) 
where Aa{s,fis) is strictly proper and stable since fi, ai, ao > or as 

G{s, fis) = Go(s)(l + Am{s, fis)), Am{s, fis) = -fi- 



lls'' + ais + ao 



where Am(s,/is) is proper and stable. 

Let us now use Definition 8.2.3 and express G(s, fis) in the form of stable factor 
perturbations. We write G{s, fis) as 

G(s us) = (^ + ^^^^'^^^ 

where 

Ai{s,ns) = -fj.- ■ ,, , ., , A2(s,/is) = -^- ■ ,, , ., 

[fis + ai)(s + A) [fis + ai)(s + A) 

and A > is an arbitrary constant. \7 

Example 8.2.2 Consider a system with the transfer function 

1 



G{s) = e 



-TS 



where t > is a small constant. As a first approximation, we can set r = and 
obtain the reduced order or nominal plant transfer function 

Go(s) = \ 
s^ 

leading to 

Gis) = Go{s){l + Amis)) 

with Am{s) = e~'^^ — 1. Using Definition 8.2.3, we can express G{s) as 

7Vo(s) + Ai(s) 



G{s) 



Do{s) + A2{s) 



where Nq{s) = ^^^y^,Da{s) = jj^:^,Ai{s) = \gl\)2 , and A2(s) = where A > 
is an arbitrary constant. 

It is clear that for small r, Am(s), Ai(s) are approximately equal to zero at low 
frequencies. V 
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Figure 8.3 General feedback system. 

8.2.4 Robust Control 

The ultimate goal of any control design is to meet the performance require- 
ments when implemented on the actual plant. In order to meet such a goal, 
the controller has to be designed to be insensitive, i.e., robust with respect to 
the class of plant uncertainties that are likely to be encountered in real life. 
In other words, the robust controller should guarantee closed-loop stability 
and acceptable performance not only for the nominal plant model but also 
for a family of plants, which, most likely, include the actual plant. 

Let us consider the feedback system of Figure 8.3 where C, F are designed 
to stabilize the nominal part of the plant model whose transfer function is 
Gq{s). The transfer function of the actual plant is G{s) and d„, d, dn, Vm are 
external bounded inputs as explained in Section 3.6. The difference between 
G{s) and Gq{s) is the plant uncertainty that can be any one of the forms 
described in the previous section. Thus G{s) may represent a family of 
plants with the same nominal transfer function Gq{s) and plant uncertainty 
characterized by some upper bound in the frequency domain. We say that 
the controller (C, F) is robust with respect to the plant uncertainties in G(s) 
if, in addition to Go{s), it also stabilizes G(s). The property of G,F to 
stabilize G(s) is referred to as robust stability. 

The following theorem defines the class of plant uncertainties for which 
the controller C, F guarantees robust stability. 

Theorem 8.2.1 Let us consider the feedback system of Figure 8.3 where 



(Q G{s) 
(n) G{s) 



Go(s) + A„(s) 
Go(s)(l + A„(s)) 
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(in) Gis) 



No{s) + Ai{s) 
Do{s) + A2(s) 



Go{s) 



Dois) 



where Aa(s), Am(s), Ai(s), A2(s), No(s), and Dq(s) are as defined in Section 
8.2.1 and assume that C,F are designed to internally stabilize the feedback 
system when G{s) = Go{s). Then the feedback system with G(s) given by 
(i), (a), (Hi) is internally stable provided conditions 



(n) 

(Hi) 



C{s)F{s) 



l + C{s)F{s)Go{s) 
C(s)F(s)Go(s) 



Saiuj) < 1 



l + C{s)F{s)Go{s) 
A2(s) + C(s)F(s)Ai(s 



5m{ui) < 1 



Do{s) + C{s)F{s)No{s) 
are satisfied for all uj, respectively. 



< 1 



5.2.20) 



5.2.211 



5.2.22) 



Proof As in Sections 3.6.1 and 3.6.2, the feedback system is internally stable if 
and only if each element of the transfer matrix 



H{.s) 



1 



1 + FCG 



1 


-FG 


-F 


-F 


c 


1 


-FC 


-FG 


CG 


G 


1 


-FCG 


CG 


G 


1 


1 



has stable poles. Because C, F are designed such that each element of H{s) with 
G = Gq has stable poles and Aq,, A^, Ai, and A2 are assumed to have stable poles, 
the only instability which may arise in the feedback system is from any unstable 
root of 

l + F{s)C{s)G{s) = (8.2.23) 



(i) Let us consider G = Gq + An, then (8.2.23) can be written as 

FGAa 

1+ ^— =0 

1 + FCGn 



.2.24) 



Because y— |^Sg-,Aa have stable poles, it follows from the Nyquist criterion that 

the roots of (8.2.24) are in the open left-half s-plane if the Nyquist plot of iipQQ 
does not encircle the (— 1, j'O) point in the complex s = a + jco plane. This condition 

is satisfied if 

G{jcj)F{ju;)Sa{u;) 



1 + G{ju;)F{JLo)GoU^) 



< 1, \/uj en 
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The above condition implies that the Nyquist plot of i,p(jQ does not encircle the 
( — l,jO) point for any Aa(s) that satisfies |Aa(Ju;)| < 6a{i^). Hence, the feedback 
system is internally stable for any G{s) in the family 

(ii) If G = Go(l + Ato) equation (8.2.23) may be written as 

FCGo , 

and the proof follows as in (i). 

(iii) If G = T^'^A^ ; equation (8.2.23) may be written as 

^ [A2 + FGAi] = 



(Do + FCNi 



Because j^ +fcn ' D +FCN ; ^2, Ai have stable poles, the result follows by apply- 
ing the Nyquist criterion as in (i). □ 

We should emphasize that conditions (8.2.20) to (8.2.22) are not only 
sufficient for stability but also necessary in the sense that if they are violated, 
then within the family of plants considered, there exists a plant G for which 
the feedback system with compensators F, C is unstable. 

Conditions (8.2.20) to (8.2.22) are referred to as conditions for robust 
stability. They may be used to choose F, C such that in addition to achieving 
internal stability for the nominal plant, they also guarantee robust stability 
with respect to a class of plant uncertainties. 

As in Section 3.6.3, let us consider the performance of the feedback sys- 
tem of Figure 8.3 with respect to the external inputs in the presence of 
dynamic plant uncertainties. We concentrate on the case where F{s) = 1 
and dn = du = ^ and the plant transfer function is given by 

G(s) = Go(s)(l + A„(s)) (8.2.25) 

By performance, we mean that the plant output y is as close to the reference 
input ym as possible for all plants G in the family Ilm despite the presence 
of the external inputs y^m d. From Figure 8.3, we have 

_ GG 1 ^ 

^ " iTCG^" + l + CG 
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or 

e = ym-y= Y—QQiVm - d) (8.2.26) 

Because 1 + CG = 1 + CGq + CGoAm, (8.2.26) can be expressed as 

^=T^%^(ym-d) (8.2.27) 

where 5*0 = i_i_(jQ , Tq = i,(jq are the sensitivity and complementary sen- 
sitivity functions for the nominal plant, respectively. 
For robust stability we require 



\To{s)\\^5^{iu) 



Cis)Gois) 



l + C{s)Go{s) 



5m{(^) < 1 



which suggests that the loop gain Lq = CGq should be much less than 1 
whenever (5m('^) exceeds 1. For good tracking performance, i.e., for small 
error e, however, (8.2.27) implies that Sq = i.qq should be small, which, in 
turn, implies that the loop gain Lq should be large. This is the classical trade- 
off between nominal performance and robust stability that is well known 
in the area of robust control. A good compromise may be found when 
Smi^) < 1 at low frequencies and v = ym — d is small at high frequencies. 
In this case the loop gain Lq = GGq can be shaped, through the choice of 
G, to be large at low frequencies and small at high frequencies. 

The trade-off design of the compensator C to achieve robust stability and 
performance can be formulated as an optimal control problem where the £2 
norm of e, i.e.. 



/■OO 

\e\\l = / e^dt 
Jo 



is minimized with respect to G for the "worst" plant within the family 11^ 
and the "worst" input v within the family of the inputs considered. This 
"min-max" approach is used in the so-called H2 and i^oo optimal control 
designs that are quite popular in the literature of robust control [45, 152]. 

8.3 Instability Phenomena in Adaptive Systems 

In Chapters 4 to 7, we developed a wide class of adaptive schemes that meet 
certain control objectives successfully for a wide class of LTI plants whose 
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parameters are unknown. Some of the basic assumptions made in designing 
and analyzing these schemes are the following: 

• The plant is free of noise disturbances, unmodeled dynamics and un- 
known nonlinearities. 

• The unknown parameters are constant for all time. 

Because in applications most of these assumptions will be violated, it is of 
interest from the practical point of view to examine the stability proper- 
ties of these schemes when applied to the actual plant with disturbances, 
unmodeled dynamics, etc. 

In this section we show that some of the simple adaptive schemes ana- 
lyzed in the previous chapters can be driven unstable by bounded distur- 
bances and unmodeled dynamics. We study several instability mechanisms 
whose understanding helps find ways to counteract them by redesigning the 
adaptive schemes of the previous chapters. 

8.3.1 Parameter Drift 

Let us consider the same plant as in the example of Section 4.2.1, where the 
plant output is now corrupted by some unknown bounded disturbance d{t) , 
i.e., 

y = e*u + d 

The adaptive law for estimating 6* derived in Section 4.2.1 for d(t) = 
Vt > is given by 

9 = 7ein, ti = y — 6u (8.3.1) 

where 7 > and 9{t) is the on-line estimate of 9* . We have shown that for 
d(t) = and u,u ^ Coo, (8.3.1) guarantees that 9,ei e £00 and ei(t) ^ as 

t ^ 00. Let us now analyze (8.3.1) when d{t) 7^ 0. Defining 9 = 9 — 9* , we 
have 

ei = —9u + d 

and 

= -^u^e + -fdu (8.3.2) 
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We analyze (8.3.2) by considering the function 

a-2 



V{9) = - (8.3.3) 

Along the trajectory of (8.3.2), we have 

V = -e\^ + d~6u = -—--(eu-df + - (8.3.4) 

For the class of inputs considered, i.e., u G £00 we cannot conclude that 
9 is bounded from considerations of (8.3.3), (8.3.4), i.e., we cannot find a 
constant Vo > such that for F > Vq, ^ < 0. In fact, for ^* = 2,7 = 1, 

u = (1 + t)~2 G Coo and 

d{t) = (1 + t)"i( - - 2(1 + f)"4 j ^ as t ^ 00 



we have 



5 1 

y(t) = -(1 + t)-4 ^ as t^ 00 



4 
1 

4' 



e^(t) = -(1 + i)-i ^ as t^ 00 



and 



^(t) = (1 + t)4 ^ 00 as t ^ 00 

i.e., the estimated parameter 6(t) drifts to infinity with time. We refer to 
this instability phenomenon as parameter drift. 

It can be easily verified that for u(t) = (1 + t)~2 the equilibrium Of. = 
of the homogeneous part of (8.3.2) is u.s. and a.s., but not u.a.s. Therefore, 
it is not surprising that we are able to find a bounded input 'jdu that leads 
to an unbounded solution 6(t) = 6{t) — 2. If, however, we restrict u{t) to be 
PE with level oq > 0, say, by choosing v? = ag, then it can be shown (see 
Problem 8.4) that the equilibrium Of. = of the homogeneous part of (8.3.2) 
is u.a.s. (also e.s.) and that 

lim sup \0(t)\ < — , do = sup \d(t)u(t)\ 
t^oo ^>j ao t 

i.e., 9(t) converges exponentially to the residual set 

do 



Dn = ie 



\e\ < 

ao 
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indicating that the parameter error at steady state is of the order of the 
disturbance level. 

Unfortunately, we cannot always choose u to be PE especially in the case 
of adaptive control where u is no longer an external signal but is generated 
from feedback. 

Another case of parameter drift can be demonstrated by applying the 
adaptive control scheme 

u = —kx, k = jx (8.3.5) 

developed in Section 6.2.1 for the ideal plant x = ax + u to the plant 

X = ax + u + d (8.3.6) 

where d(t) is an unknown bounded input disturbance. It can be verified that 
for /c(0) = 5, x(0) = 1, a = 1, 7 = 1 and 

d{t) = (1 + t)-^ (5 - (1 + t)"^ - 0.4(1 + t)-i) ^0 as t^ 00 

the solution of (8.3.5), (8.3.6) is given by 

x(i) = (1 + t)-i ^ as t^ 00 

and 

k(t) = 5(1 +t)5^oo as i^oo 

We should note that since k(0) = 5 > 1 and k(t) > k(0) Vt > parameter 
drift can be stopped at any time t by switching off adaptation, i.e., setting 
7 = in (8.3.5), and still have x,u ^ Coo and x{t) —i-Oast—i- 00. For 
example, if 7 = for t > ti > 0, then k(t) = k \/t > ti, where /c > 5 is a 
stabilizing gain, which guarantees that n, x £ £00 and x{t) ^ as t ^ cx). 

One explanation of the parameter drift phenomenon may be obtained by 
solving for the "quasi" steady state response of (8.3.6) with u = —kx., i.e., 

d 

Xs « 

k — a 
Clearly, for a given a and d, the only way for Xs to go to zero is for k ^ 00. 
That is, in an effort to eliminate the effect of the input disturbance d and send 
X to zero, the adaptive control scheme creates a high gain feedback. This 
high gain feedback may lead to unbounded plant states when in addition to 
bounded disturbances, there are dynamic plant uncertainties, as explained 
next. 
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8.3.2 High-Gain Instability 

Consider the following plant: 

y 1- ^ls 1 



^ '^fJ'S 



1 + fis 



(8.3.7) 



u (s — a)(l + /is) s — 

where ;U is a small positive number which may be due to a small time constant 
in the plant. 

A reasonable approximation of the second-order plant may be obtained 
by approximating /x with zero leading to the first-order plant model 

y 1 



u 



(8.3.8) 



where y denotes the output y when fi = 0. The plant equation (8.3.7) is in 
the form of y = 6*0(1 + Am)u where Gois) = -^ and Amis) = -^j^- It 
may be also expressed in the singular perturbation state-space form discussed 
in Section 8.2, i.e., 

X = ax + z — u 

l^z = -z + 2u (8.3.9) 

y = X 

Setting /x = in (8.3.9) we obtain the state-space representation of (8.3.8), 
i.e., 

^ = ('^ + '^ (8.3.10) 

y = X 

where x denotes the state x when ^ = 0. Let us now design an adaptive 
controller for the simplified plant (8.3.10) and use it to control the actual 
second order plant where fi > 0. As we have shown in Section 6.2.1, the 
adaptive law 

u = —kx, k = 7eix, ei = x 

can stabilize (8.3.10) and regulate y = x to zero. Replacing y with the actual 
output of the plant y = x, we have 

u = —kx, k = 7eix, ei = x (8.3.11) 

which, when applied to (8.3.9), gives us the closed- loop plant 



X = (a + k)x + z 
/xi = —z — 2kx 



^.3.12) 
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whose equilibrium Xe = 0,Ze = with k = k* is a.s. if and only if the 
eigenvalues of (8.3.12) with k = k* are in the left-half s-plane, which implies 

that 

1 

a > k > a 

Because fc > 0, it is clear that 

k(0) > - - o ^ k(t) > - -a, Vt > 

that is, from such a k(0) the equilibrium of (8.3.12) cannot be reached. 

Moreover, with k > a the linear feedback loop is unstable even when the 

adaptive loop is disconnected, i.e., 7 = 0. 

We refer to this form of instability as high-gain instability. The adaptive 
control law (8.3.11) can generate a high gain feedback which excites the 
unmodeled dynamics and leads to instability and unbounded solutions. This 
type of instability is well known in robust control with no adaptation [106] 
and can be avoided by keeping the controller gains small (leading to a small 
loop gain) so that the closed-loop bandwidth is away from the frequency 
range where the unmodeled dynamics are dominant. 

8.3.3 Instability Resulting from Fast Adaptation 

Let us consider the second-order plant 

X = —X + bz — u 

Hz = -z + 2u (8.3.13) 

y = X 

where b > 1/2 is an unknown constant and /i > is a small number. For 
u = 0, the equilibrium x^ = 0, z^ = is e.s. for all /U > 0. The objective 
here, however, is not regulation but tracking. That is, the output y = x is 
required to track the output Xm of the reference model 

Xm = -Xm + r (8.3.14) 

where r is a bounded piecewise continuous reference input signal. For /U = 0, 
the reduced-order plant is 

^=-x + (26-l)n 
y = X 
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which has a pole at s = — 1, identical to that of the reference model, and an 
unknown gain 26 — 1 > 0. The adaptive control law 



Ir, I 



-7eir, ei 



X Xtt 



(8.3.16) 



guarantees that x{t),l{t) are bounded and \x{t) — Xm{t)\ ^ as t ^ oo for 
any bounded reference input r. If we now apply (8.3.16) with x replaced by 
X to the actual plant (8.3.13) with ^ > 0, the closed-loop plant is 



X = 

i = 



-X + bz — Ir 

-z + 2lr 
--fr{x - Xm) 



5.3.17) 



When 7 = that is when / is fixed and finite, the signals x(t) and z(t) are 
bounded. Thus, no instability can occur in (8.3.17) for 7 = 0. 

Let us assume that r = constant. Then, (8.3.17) is an LTI system of the 
form 

Y = AY + B-frXm (8.3.18) 

where Y = [x, z, 1^,3 = [0, 0, 1]^, 



A 



and 'jrxm is treated as a bounded input. The characteristic equation of 
(8.3.18) is then given by 



-1 


b -r 





-l//i 2r//x 


7r 






det(s/ -A) = s^ + (1 + -)s^ + (-^ 



Using the Routh-Hurwitz criterion, we have that for 

2 ^ 1 (1 + /^) 



7r^)s+ -r2(26- 1) (8.3.19) 



H{2b + ii) 



5.3.20) 



two of the roots of (8.3.19) are in the open right-half s-plane. Hence given any 
/i > 0, if 7,r satisfy (8.3.20), the solutions of (8.3.18) are unbounded in the 
sense that |y(t)| ^ oo as t ^ oo for almost all initial conditions. Large ^r"^ 
increases the speed of adaptation, i.e., I, which in turn excites the unmodeled 
dynamics and leads to instability. The effect of / on the unmodeled dynamics 
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can be seen more clearly by defining a new state variable r] = z — 2lr, called 
the parasitic state [85, 106], to rewrite (8.3.17) as 

X = —X + (2fe — l)lr + br] 

lirj = —t] + 2fi^r'^{x — Xm) — 2filr (8.3.21) 

i = -'yr(x - Xm) 

where for r = constant, r = 0. Clearly, for a given fi, large 7r^ may lead to 
a fast adaptation and large parasitic state r] which acts as a disturbance in 
the dominant part of the plant leading to false adaptation and unbounded 
solutions. For stability and bounded solutions, 7r^ should be kept small, i.e., 
the speed of adaptation should be slow relative to the speed of the parasitics 
characterized by -. 

8.3.4 High-Frequency Instability 

Let us now assume that in the adaptive control scheme described by (8.3.21), 
both 7 and \r\ are kept small, i.e., adaptation is slow. We consider the case 
where r = r^ sin cvt and ro is small but the frequency co can be large. At 
lower to middle frequencies and for small 7r^, n, we can approximate //?) ~ 
and solve (8.3.21) for r], i.e., rj ~ 2ii'yr'^(x — Xm) — 2fj,lr, which we substitute 
into the first equation in (8.3.21) to obtain 

X = -(1 - 2fibjr'^)x + (gr - 2bfif)l - 2^bjr'^Xm ,^ „ oo) 

I = --fr{x - Xm) 

where g = 26—1. Because -yr is small we can approximate l(t) with a 
constant and solve for the sinusoidal steady-state response of x from the 
first equation of (8.3.22) where the small jiyr'^ terms are neglected, i.e.. 



^0 r^ r,u 2^ 

l+tj2 



Xss = :; — ^ — 2^^S ~ 2bfiuj )sina;t — uj{g + 2fe^)cosa;t]/ 



Now substituting for x = Xgs in the second equation of (8.3.22) we obtain 



,,2 



7rQ sinwi r ox ^ \ 1 

Is = ^— ig — 2bfiuj ) sinujt — uj{g + 2bfi)cosujt\ Ig + jXmrosinujt 

1 -1- (U^ L J 

Is = a{t)ls + 'yxmrosinujt (8.3.23) 



1 + iO 

i.e.. 
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A 'yrr.smujt r. , 2\ / 7 \ 1 

a[t) = 2~ \9 ~ '^bfiuj ) siiiLot — LO[g + 2bfi)cosu!t\ 

where the subscript 's' indicates that (8.3.23) is approximately vahd for 
slow adaptation, that is, for 7rQ(l + lo'^)~^''^ sufficiently small. The slow 
adaptation is unstable if the integral of the periodic coefficient a(t) over the 
period is positive, that is, when fiu)'^ > g/{2b), or w^ > g/{2bfi) [3]. 

The above approximate instability analysis indicates that if the reference 
input signal r(t) has frequencies in the parasitic range, (i.e., of the order of - 
and higher), these frequencies may excite the unmodeled dynamics, cause the 
signal-to-noise ratio to be small and, therefore, lead to the wrong adjustment 
of the parameters and eventually to instability. We should note again that 
by setting 7 = 0, i.e., switching adaptation off, instability ceases. 

A more detailed analysis of slow adaptation and high-frequency instabil- 
ity using averaging is given in [3, 201]. 

8.3.5 Effect of Parameter Variations 

Adaptive control was originally motivated as a technique for compensating 
large variations in the plant parameters with respect to time. It is, therefore, 
important to examine whether the adaptive schemes developed in Chapters 
4 to 7 can meet this challenge. 

We consider the linear time varying scalar plant 

X = a{t)x + b{t)u (8.3.24) 

where a(t) and b(t) are time varying parameters that are bounded and have 
bounded first order derivatives for all t and 6(t) > 60 > 0. We further assume 
that |o(t)|, \b(t)\ are small, i.e., the plant parameters vary slowly with time. 
The objective is to find u such that x tracks the output of the LTI reference 
model 

m — •^m T^ ' 

for all reference input signals r that are bounded and piecewise continuous. 
If a{t), b{t) were known for all t > 0, then the following control law 

u= -k*{t)x + l*{t)r 

where 

" ^^' - bit) ' ' ^*^ " bit) 
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would achieve the control objective exactly. Since a(t) and b(t) are unknown, 
we try 

u= -k{t)x + l{t)r 

together with an adaptive law for adjusting k{t) and l{t). Let us use the same 
adaptive law as the one that we would use if a{t) and b{t) were constants, 
i.e., following the approach of Section 6.2.2, we have 

k = 7ieia;, l = -72eir, 71,72 > (8.3.25) 

where ei = e = x — Xm satisfies 

li = -ei + b{t){-kx + lr) (8.3.26) 

where k{t) = k{t) - k*{t)J{t) = l{t) - l*{t). Because k*{t),l*{t) are time 
varying, k = k — k*,l = 1 — 1* and therefore (8.3.25), rewritten in terms of 
the parameter error, becomes 

k = -fitix-k\ [=-72eir-r (8.3.27) 

Hence, the effect of the time variations is the appearance of the disturbance 
terms k* ,1*, which are bounded because d(t), b(t) are assumed to be bounded. 
Let us now choose the same Lyapunov-like function as in the LTI case for 
analyzing the stability properties of (8.3.26), (8.3.27), i.e., 

y(ei, k, = y + m^ + m^ (8.3.28) 

2 271 272 

where b{t) > 60 > 0. Then along the trajectory of (8.3.26), (8.3.27) we have 



V = —ti — tibkx + eiblr + b- h bkeix 



271 71 

• P , [/* 

+b bleir — b — 

272 72 

2 b fP P\ , fkk* U*\ 
2 \7i 72/ \7i 12 J 

From (8.3.28) and (8.3.29) we can say nothing about the boundedness of 
ei,k,l unless k*,l* are either zero or decaying to zero exponentially fast. 
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Even if k*(t), l*{t) are sufficiently small, i.e., a(i), b{t) vary sufficiently slowly 
with time, the boundedness of €i,k,l can not be assured from the properties 
of V, V given by (8.3.28), (8.3.29) no matter how small d, b are. 

It has been established in [9] by using a different Lyapunov-like function 
and additional arguments that the above adaptive control scheme guarantees 
signal boundedness for any bounded a(t), 6(t) with arbitrary but finite speed 
of variation. This approach, however, has been restricted to a special class 
of plants and has not been extended to the general case. Furthermore, the 
analysis does not address the issue of tracking error performance that is 
affected by the parameter variations. 

The above example demonstrates that the empirical observation that an 
adaptive controller designed for an LTI plant will also perform well when the 
plant parameters are slowly varying with time, held for a number of years in 
the area of adaptive control as a justification for dealing with LTI plants, may 
not be valid. In Chapter 9, we briefly address the adaptive control problem 
of linear time varying plants and show how the adaptive and control laws 
designed for LTI plants can be modified to meet the control objective in the 
case of linear plants with time varying parameters. For more details on the 
design and analysis of adaptive controllers for linear time varying plants, the 
reader is referred to [226]. 

8.4 Modifications for Robustness: Simple Exam- 
ples 

The instability examples presented in Section 8.3 demonstrate that the adap- 
tive schemes designed in Chapters 4 to 7 for ideal plants, i.e., plants with no 
modeling errors may easily go unstable in the presence of disturbances or un- 
modeled dynamics. The lack of robustness is primarily due to the adaptive 
law which is nonlinear in general and therefore more susceptible to modeling 
error effects. 

The lack of robustness of adaptive schemes in the presence of bounded 
disturbances was demonstrated as early as 1979 [48] and became a hot issue 
in the early 1980s when several adaptive control examples are used to show 
instability in the presence of unmodeled dynamics and bounded disturbances 
[86, 197]. It was clear from these examples that new approaches and adaptive 
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laws were needed to assure boundedness of all signals in the presence of plant 
uncertainties. These activities led to a new body of work referred to as robust 
adaptive control. 

The purpose of this section is to introduce and analyze some of the 
techniques used in the 1980s to modify the adaptive laws designed for ideal 
plants so that they can retain their stability properties in the presence of 
"reasonable" classes of modeling errors. 

We start with the simple plant 

y = 0*U + T] (8.4.1) 

where r] is the unknown modeling error term and y, u are the plant output 
and input that are available for measurement. Our objective is to design an 
adaptive law for estimating 6* that is robust with respect to the modeling 
error term r]. By robust we mean the properties of the adaptive law for /? / 
are "close" ( within the order of the modeling error) to those with 77 = 0. 
Let us start with the adaptive law 

= 'yeiu, €i = y-0u (8.4.2) 

developed in Section 4.2.1 for the plant (8.4.1) with rj = and u G Coo, and 
shown to guarantee the following two properties: 

(i) ei,e,eeCoo, (ii) ei,^e/:2 (8.4.3) 

If in addition n £ £00 ) the adaptive law also guarantees that ei,9 -^ as 
t ^ 00. When T] = but u £00 instead of (8.4.2) we use the normalized 
adaptive law 

= jeu, € = ^—^^ 8.4.4 

where m is the normalizing signal that has the property of — £ £00 • A 
typical choice for m in this case is m? = 1 + v?. The normalized adaptive 
law (8.4.4) guarantees that 

(i) e, em, 6,6 (^ Coo, (ii) e, ern, 9 E C2 (8.4.5) 

We refer to properties (i) and (ii) given by (8.4.3) or (8.4.5) and established 
for ?] = as the ideal properties of the adaptive laws. When r] ^^ 0, the 
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adaptive law (8.4.2) or (8.4.4) can no longer guarantee properties (i) and 
(ii) given by (8.4.3) or (8.4.5). As we have shown in Section 8.3.1, we can 
easily find a bounded modeling error term r], such as a bounded output 
disturbance, that can cause the parameter estimate 6(t) to drift to infinity. 

In the following sections, we introduce and analyze several techniques 
that can be used to modify the adaptive laws in (8.4.2) and (8.4.4). The 
objective of these modifications is to guarantee that the properties of the 
modified adaptive laws are as close as possible to the ideal properties (i) and 
(ii) given by (8.4.3) and (8.4.5) despite the presence of the modeling error 
term ?? / 0. 

We first consider the case where r] is due to a bounded output disturbance 
and u e Coo- We then extend the results to the case where u £ £oo and 
rj is due to a dynamic plant uncertainty in addition to a bounded output 
disturbance. 

8.4.1 Leakage 

The idea behind leakage is to modify the adaptive law so that the time deriva- 
tive of the Lyapunov function used to analyze the adaptive scheme becomes 
negative in the space of the parameter estimates when these parameters ex- 
ceed certain bounds. We demonstrate the use of leakage by considering the 
adaptive law (8.4.2) 

9 = •yeiu, ei = y — 6u 

with u e Coo for the plant (8.4.1), which we rewrite in terms of the parameter 

error 9 = — 9* as 

9 = 'ytiu, ei = -9u + r] (8.4.6) 

The modeling error term rj, which in this case is assumed to be bounded, 
affects the estimation error which in turn affects the evolution of 9(t). Let 
us consider the Lyapunov function 

Vi9) = ^ (8.4.7) 

that is used to establish properties (i) and (ii), given by (8.4.3), when rj = 0. 
The time derivative of V along the solution of (8.4.6) is given by 

V = hiu = -el + tir, < -|ei|(|ei| - do) (8.4.8) 
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where do > is an upper bound for the error term rj. From (8.4.7) and 
(8.4.8), we cannot conclude anything about the boundedness of 9 because 
the situation where |ei| < do, i.e., V >0 and 9(t) ^ oo as t ^ cx) cannot be 
excluded by the properties of V and V for all input signals u £ £oo- 

One way to avoid this situation and establish boundedness in the presence 
of r] is to modify the adaptive law as 

6 = 'yeiu — jwO, ti = y — 9u (8.4.9) 

where the term w9 with w > Q converts the "pure" integral action of the 
adaptive law given by (8.4.6) to a "leaky" integration and is therefore re- 
ferred to as the leakage modification. The design variable w{t) > is to 
be chosen so that for F > Vb > and some Vb, which may depend on 
dO) the time derivative F < 0. Such a property of V, V will allow us to 
apply Theorem 3.4.3 and establish boundedness for V and, therefore, for 
9. The stability properties of the adaptive law (8.4.9) are described by the 
diff^erential equation 

9 = jeiu- 'jw9, ei = -9u + r] (8.4.10) 

Let us analyze (8.4.10) for various choices of the leakage term w(t). 

(a) a -modification [85, 86]. The simplest choice for w(t) is 

w{t) = cr > 0, Vt > 

where cr is a small constant and is referred to as the fixed a -modification. 
The adaptive law becomes 

9 = jeiu — ^a9 

and in terms of the parameter error 

9 = jeiu-ja9, e=-9u + ri (8.4.11) 

The time derivative of 1/ = 2- along any trajectory of (8.4.11) is given by 

V = -el + eiT] - a99 < -ej + \ei\do - a99 (8.4.12) 
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Using completion of squares, we write 

-e? + |ei|do<-|-^[ei-rfo]^ + f <-| + f 
and 

-aOe = -a0(0 + 0*) < -aP + a|^||r | < -— + "^^—^ (8.4.13) 

Therefore, 

^2 ^/j2 j2 ^|/3*|2 

- 2 2 2 2 

Adding and subtracting the term aV for some a > 0, we obtain 

V <-aV - ^-{a- -]— + ^ + 



2 V 7/ 2 2 2 

If we choose < a < a7, we have 

dl CTirP 
V<-aV+^ + ^^ (8.4.14) 

which implies that for V > Vq = 2^(1^0 + o"l^*P))^ — 0- Therefore, using 
Theorem 3.4.3, we have that 0,0 & Coo which, together with u £ £00 imply 
that ei,0 ^ Coo- Hence, with the a- modification, we managed to extend 
property (i) given by (8.4.3) for the ideal case to the case where 77 / 
provided r] £ Coo- In addition, we can establish by integrating (8.4.14) that 

27 27 Za 

which implies that 9 converges exponentially to the residual set 

D^ = UeTZ 0^ < -{dl + a\0*f) 
[ a 

Let us now examine whether we can extend the ideal property (ii) ei, 
^ C2 given by (8.4.3) for the case of r/ = to the case where ?/ / but 
7] e Coo- 

We consider the following expression for V: 

V< — i - cr— + -^ + 0-J— L (8.4.15 

- 2 2 2 2 ^ ' 
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obtained by using the inequality 



i2 m*|2 



-aee < -a hcr- 



2 2 

instead of (8.4.13). Integrating (8.4.15) we obtain 

rt+T ft+T 

/ tldT+ / ae'^dr < {dl + a\e*\'^)T + 2[V{t)-V{t + T)] < CQ{dl + (j)T + ci 

(8.4.16) 

Vt > and r > where cq = max[l, \e*\^],ci = 2supt[V{t) - V{t + T)]. 
Expression (8.4.16) implies that ei, \/o'9 are (dQ + (j)-sniall in the mean square 
sense (m.s.s.), i.e., ei, \/o-9 £ S(dQ + it). Because 

1^1^ < 2jhlu^ + 27^2^2 

it follows that 9 is also (dg + o')-small in the m.s.s., i.e., 9 £ S(dQ + a). 
Therefore, the ideal property (ii) extends to 

(ii)' ei,9eSidl + a) (8.4.17) 

The £2 property of ei,9 can therefore no longer be guaranteed in the presence 
of the nonzero modeling error term r]. The £2 property of ei was used in 
Section 4.2.1 together with u G £00 to establish that ei(t) ^ as t ^ cx). It 
is clear from (8.4.17) and the analysis above that even when the disturbance 
7] disappears, i.e., r/ = 0, the adaptive law with the cT-modification given 
by (8.4.11) cannot guarantee that ei,6 e £2 or that ei(t) ^ as t ^ 00 
unless (7 = 0. Thus robustness is achieved at the expense of destroying the 
ideal property given by (ii) in (8.4.3) and having possible nonzero estimation 
errors at steady state. This drawback of the a-modification motivated what 
is called the switching a-modification described next. 

(b) Switching-a [91]. Because the purpose of the cr- modification is to avoid 
parameter drift, it does not need to be active when the estimated parameters 
are within some acceptable bounds. Therefore a more reasonable modifica- 
tion would be 

/,^ / if 1^1 < Mo 

w{t) = as, crs= < .f \'. , , , 

I (Jo if \0\ > Mq 
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2Mo 
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Figure 8.4 Continuous switching a-niodification. 



where Mg > 0, ao > are design constants and Mq is chosen to be large 
enough so that Mq > \Q*\- With the above choice of iTs, however, the adaptive 
law (8.4.9) is a discontinuous one and may not guarantee the existence of the 
solution 0(t). It may also cause oscillations on the switching surface \Q\= Mq 
during implementation. The discontinuous switching a-modification can be 
replaced with a continuous one such as 

if \d{t)\ < Mo 
l) if Mo < \0(t)\ < 2Mo (8.4.18) 

^0 if \Oit)\ > 2Mo 

shown in Figure 8.4 where the design constants Mo,o"o are as defined in 
the discontinuous switching a-modification. In this case the adaptive law is 
given by 

= 'jeiu — 'yagO, ti = y — 9u 

and in terms of the parameter error 



w{t) 





^0 V A//0 



7ei-u - ^asV, ei 



-9u + f] 



The time derivative of V{6) 
given by 



Now 



27 



along the solution of (8.4.18), 



V 



-el + ei?7 - as 



< 



+ 



"0 



= as{e-e*)e>aM''-^s\e\\e*\ 

> a,|^|(|0|-Mo + Mo-|r|) 



(8.4.19) 
5.4.19) is 

(8.4.20) 
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i.e., 

(TsOe > as\e\{\e\ - Mo) + a,|^|(Mo - \e*\) > o (8.4.21) 

where the last inequaUty follows from the fact that ag > 0, (Ts(|0| — Mg) > 
and Mq > |^*|. Hence, —agOB < 0. Therefore, in contrast to the fixed a- 
modification, the switching a can only make V more negative. We can also 
verify that 

-asOe < -aoOe + 2aoM^ (8.4.22) 

which we can use in (8.4.20) to obtain 

V <-^- aoOe + 2aoM^ + -^ (8.4.23) 

The boundedness of V and, therefore, of 6 follows by using the same pro- 
cedure as in the fixed a case to manipulate the term aoOO in (8.4.23) and 
express V as 

V < -aV + 2(7oM2 + ^ + ao^ 

where < a < (707 which implies that 6 converges exponentially to the 
residual set 



Ds = {6 



1^1^ < -(cfg + ao|rp+4aoMo2) 
a 



The size of Dg is larger than that of Do- in the fixed a-modification case 
because of the additional term 4(ToMq . The boundedness of 6 implies that 
0, 0, ei G £00 and, therefore, property (i) of the unmodified adaptive law in 
the ideal case is preserved by the switching a-modification when 77 / but 
7] e Coo- 
ks in the fixed cr-modification case, the switching a cannot guarantee 
the £2 property of t\^Q in general when r/ / 0. The bound for t\ in m.s.s. 
follows by integrating (8.4.20) to obtain 

rt+T rt+T 

2 / asOOdr + / ejclr < dlT + ci 
where ci = 2supt>o[F(t) - V{t + r)],Vt > 0,r > 0. Because asOO > it 



follows that \lus09,ti G S{df^). From (8.4.21) we have 0^90 > as\9\{MQ 
\9*\) and, therefore. 



{as9ef 

{Mo-\9*\f 



-i\G\' < .:r^:', < c^s 



562 CHAPTER 8. ROBUST ADAPTIVE LAWS 

for some constant c that depends on the bound for o-qI^I, which iniphes that 
(Js\d\ £ '5(do)- Because 

it follows that \9\ £ 5(^0)- Hence, the adaptive law with the switching-c 
modification given by (8.4.19) guarantees that 

(ii)' ei,^e5(dg) 

In contrast to the fixed cr-modification, the switching a preserves the ideal 
properties of the adaptive law, i.e., when rj disappears (r] = do = 0), equation 



(8.4.20) implies (because —OsOO < 0) that ei e £2 and yagOO e C2, which, 
in turn, imply that ^ £ £2- In this case if u e Coo, we can also establish 
as in the the ideal case that ei{t),6{t) -^ as t ^ 00, i.e., the switching 
a does not destroy any of the ideal properties of the unmodified adaptive 
law. The only drawback of the switching a when compared with the fixed 
a is that it requires the knowledge of an upper bound Mq for |^*|. If Mq in 
(8.4.18) happens not to be an upper bound for \9*\, then the adaptive law 
(8.4.18) has the same properties and drawbacks as the fixed cr-modification 
(see Problem 8.7). 

(c) ei-modification [172]. Another attempt to eliminate the main drawback 
of the fixed a-modification led to the following modification: 

w{t) = \ei\i^o 

where i^o > is a design constant. The adaptive law becomes 

(9 = 7eiu-7|ei|i/o^, ti = y - Ou 

and in terms of the parameter error 

= 7eiu-7|ei|i/o^, ei = -9u + r] (8.4.24) 

The logic behind this choice of w is that because in the ideal case ei is 
guaranteed to converge to zero (when ii G £00)) then the leakage term w{t)9 
will go to zero with ei when rj = 0; therefore, the ideal properties of the 
adaptive law (8.4.24) when r] = will not be aifected by the leakage. 
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(32 



The time derivative of V{9) = y~ along the solution of (8.4.24) is given 
by 

V=-el + eir] - \ei\uo9e < -\ei\ |ei| + i^o— - ^^o^^ - ^0 (8.4.25) 



where the inequality is obtained by using uqOO < —vq^ + />o 2~' ^^ ^^ 



clear that for |ei| + vq^ > vq-^ + do, i.e., for V > Vq = :^(t'o 2~ + '^o) 
we have V < 0, which implies that V and, therefore, 9,9 ^ Coo- Because 
ei = —9u + ri and u G Coo we also have that €i G £00, which, in turn, implies 
that 9 e Coo- Hence, property (i) is also guaranteed by the ei-modification 
despite the presence of 77 / 0. 

Let us now examine the £2 properties of ei, guaranteed by the unmod- 
ified adaptive law {w{t) = 0) when r/ = 0. We rewrite (8.4.25) as 

V < -— + y - leikot' - \ti\VQti < -— ^ h |ei|fo^ \- y 

by using the inequality —0? ± a6 < — ^ + ^. If we repeat the use of the 
same inequality we obtain 

^2 M |/)*|4 

y<-i + i + -o^ (8.4.26) 

Integrating on both sides of (8.4.26), we establish that ei £ S{d^ + fg). 
Because u,9 €z Coo, it follows that \9\ < c\ei\ for some constant c > and 
therefore 9 e <S(dQ + z^q). Hence, the adaptive law with the ei-modification 
guarantees that 

(ii)' ei,9eS{dl + ui) 

which implies that ei, 9 are of order of do, pq in m.s.s. 

It is clear from the above analysis that in the absence of the disturbance 
i.e., rj = {),V cannot be shown to be negative definite or semidefinite unless 
vq = 0. The term |ei|i^o^^ in (8.4.25) may make V positive even when 77 = 
and therefore the ideal properties of the unmodified adaptive law cannot 
be guaranteed by the adaptive law with the ei-modification when rj = 
unless uq = 0. This indicates that the initial rationale for developing the 
ei-modification is not valid. It is shown in [172], however, that if u is PE, 
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then ei(t) and therefore w(t) = z>oki(i)| do converge to zero as t ^ cx) when 
ri(t) = 0,Vt > 0. Therefore the ideal properties of the adaptive law can be 
recovered with the ei-modification provided u is PE. 



Remark 8.4.1 



(i) Comparing the three choices for the leakage term w(t), it is clear that 
the fixed a- and ei-modification require no a priori information about 
the plant, whereas the switching-a requires the design constant Mq to 
be larger than the unknown |^*|. In contrast to the fixed a- and €i- 
modifications, however, the switching a achieves robustness without 
having to destroy the ideal properties of the adaptive scheme. Such 
ideal properties are also possible for the ei-modification under a PE 
condition[172]. 

(ii) The leakage —w9 with w(t) > introduces a term in the adaptive law 
that has the tendency to drive 6 towards 6 = when the other term 
(i.e., 'jeiu in the case of (8.4.9)) is small. If 6* / 0, the leakage term 
may drive 9 towards zero and possibly further away from the desired 
9*. If an a priori estimate 9* of 9* is available the leakage term —w9 
may be replaced with the shifted leakage —w{9 — 9*), which shifts the 
tendency of 9 from zero to 9*, a point that may be closer to 9*. The 
analysis of the adaptive laws with the shifted leakage is very similar to 
that of —w9 and is left as an exercise for the reader. 

(iii) One of the main drawbacks of the leakage modifications is that the es- 
timation error ei and 9 are only guaranteed to be of the order of the 
disturbance and, with the exception of the switching cr-modification, of 
the order of the size of the leakage design parameter, in m.s.s. This 
means that at steady state, we cannot guarantee that ei is of the order 
of the modeling error. The m.s.s. bound of ei may allow ei to exhibit 
"bursting," i.e., ei may assume values higher than the order of the mod- 
eling error for some finite intervals of time. One way to avoid bursting 
is to use PE signals or a dead-zone modification as it will be explained 
later on in this chapter 
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(iv) The leakage modification may be also derived by modifying the cost 
function J (6) = ^ = 2" ' used in the ideal case, to 

m-'^^.4 (8.4.7) 

Using the gradient method, we now obtain 

6 = —7V J = 7ein — 'ywO 

which is the same as (8.4.9). The modified cost now penalizes 6 in 
addition to ei which explains why for certain choices of w(t) the drifting 
of 6 to infinity due to the presence of modeling errors is counteracted. 



8.4.2 Parameter Projection 

An effective method for eliminating parameter drift and keeping the param- 
eter estimates within some a priori defined bounds is to use the gradient pro- 
jection method to constrain the parameter estimates to lie inside a bounded 
convex set in the parameter space. Let us illustrate the use of projection for 
the adaptive law 

6 = 7eiu, €1 = y — 9u 

We like to constrain 9 to lie inside the convex bounded set 

gi9)^{e\0'<Mi} 

where Mq > \9*\. Applying the gradient projection method, we obtain 

7eiu if \e\ < Mo 

or if \9\ = Mo and Otiu < (8.4.28) 

if \e\ = Mo and Oem > 

ei = y — 6u = —6u + rj 

which for |6l(0)| < Mq guarantees that \e{t)\ < Mo,Vt > 0. Let us now 
analyze the above adaptive law by considering the Lyapunov function 

27 
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whose time derivative V along (8.4.28) is given by 

-4 + ^iV if 1^1 < Mo 

V = { or if i^i = Mo and flem < (8.4.29) 

if i^i = Mo and Oeiu > 

Let us consider the case when V = 0, \9\ = Mq and 9eiu > 0. Using the 
expression ei = —0u + r/, we write V = = —t\ + eir/ — Oeiu. The last term 
in the expression of V can be written as 

Otiu = {9 - e*)tiu = Mosgn{e)eiu - e*tiu 

Therefore, for Oeiu > and \6\ = Mq we have 

0eiu = Mo\eiu\ - e*eiu > Mo\eiu\ - |6'*||ein| > 

where the last inequality is obtained by using the assumption that Mq > |^*|, 
which implies that for \9\ = Mq and 9eiu > we have 9eiu > and that 
V = < -el + eir/. Therefore, (8.4.29) implies that 

V<-el + ei7]< — ^ + ^, Vt>0 (8.4.30) 

A bound for ei in m.s.s. may be obtained by integrating both sides of 
(8.4.30) to get 

rt+T 

/ €ldT<4T + 2{V(t)-V(t + T)} 

Vt > and any T > 0. Because V £ Coo, it follows that ei £ 5(^0) • 

The projection algorithm has very similar properties and the same ad- 
vantages and disadvantages as the switching a-modification. For this reason, 
the switching a-modification has often been referred to as "soft projection." 
It is soft in the sense that it allows |^(t)| to exceed the bound Mq but it does 
not allow \9{t)\ to depart from Mq too much. 

8.4.3 Dead Zone 

Let us consider the adaptive error equation (8.4.6) i.e., 

e = -feiu, ei = -eu + r] (8.4.31) 
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/(ei) = ei+5 



-90 




f{ei) = ei + g 



-90 




(a) (b) 

Figure 8.5 Dead zone functions: (a) discontinuous (b) continuous. 



Because supj?7(t)| < do, it follows that if |ei| :$> do then the signal 0u 
is dominant in ei. If, however, |ei| < do then r] may be dominant in ei. 
Therefore small ei relative to do indicates the possible presence of a large 
noise (because of r]) to signal (9u) ratio, whereas large ei relative to do 
indicates a small noise to signal ratio. Thus, it seems reasonable to update 
the parameter estimate 6 only when the signal 9u in ei is large relative to 
the disturbance rj and switch-off adaptation when ei is small relative to the 
size of r/. This method of adaptation is referred to as dead zone because 
of the presence of a zone or interval where 6 is constant, i.e., no updating 
occurs. The use of a dead zone is illustrated by modifying the adaptive law 
9 = 7ein used when r; = to 



ei 



= 7M(ei+5), g = 
= y — 9u 



if |ei| > go 
-ei if |ei| < go 



5.4.32) 



where go > is a known strict upper bound for |?/(t)|, i.e., go > do > 
sup^ |?7(t)|. The function /(ei) = ei + g \s known as the dead zone function 
and is shown in Figure 8.5 (a). 

It follows from (8.4.32) that for small ei, i.e., |ei| < go, we have = 
and no adaptation takes place, whereas for "large" ei, i.e., |ei| > go, we 
adapt the same way as if there was no disturbance, i.e., 9 = 'jeiu. Because 
of the dead zone, 9 in (8.4.32) is a discontinuous function which may give 
rise to problems related to existence and uniqueness of solutions as well as 
to computational problems at the switching surface [191]. One way to avoid 
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these problems is to use the continuous dead zone shown in Figure 8.5(b). 

Using the continuous dead-zone function from Figure 8.5 (b), the adap- 
tive law (8.4.32) becomes 



7n(ei + g), g = < 



go if ei < -go 
-go if ei > go 
-ei if |ei| < go 



5.4.33) 



which together with 



ei 



-9u + rj 



describe the stability properties of the modified adaptive law. We analyze 
(8.4.33) by considering the Lyapunov function 



V 



27 



whose time derivative V along the trajectory of (8.4.33) is given by 
V = eu{ei + g) = -{ei-ri){ei+g) { 

Now, 

\r]\ 



5.4.34) 



(ei -^)(ei + 



(ei - ^)(ei + flo) > if ei < -50 < - 
(ei - ^)(ei - flo) > if ei > 5-0 > \v\ 
if |ei| < go 



i.e., (ei — ??)(ei + (?) > Vt > and, therefore, 

V = -{ei - ri){ei + g) < 



which implies that V,0,9 e £00 and that \/(ei — ri)i^i + d) ^ ■^2- The 
boundedness of 9,u implies that ei,9 £ £oo- Hence, the adaptive law with 
the dead zone guarantees the property ei, £ £00 in the presence of nonzero 
rj e Coo- Let us now examine the £2 properties of ei,9 that are guaranteed 
by the unmodified adaptive law when 77 = 0. We can verify that 

(ei + ff)^<(ei-r/)(ei + (?) 



for each choice of g given by (8.4.33). Since \/{ei — ??)(ei + g) £ £2 it follows 
that (ei + g) e £2 which implies that ^ £ £2. Hence, the dead zone preserves 
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the £2 property of 9 despite the presence of the bounded disturbance rj. Let 
us now examine the properties of ei by rewriting (8.4.34) as 

V = -ef - eig + eiT] + r]g 

< -ef + \ei\go + \ei\do + dogo 

By completing the squares, we obtain 

V < -'1 + ^^^^±^ + dogo 
- 2 2 

which imphes that ei £ 5((io + 5'o)- Therefore, our analysis cannot guarantee 
that ei is in £2 but instead that ei is of the order of the disturbance and 
design parameter go in m.s.s. Furthermore, even when rj = 0, i.e., dg = we 
cannot establish that ei is in £2 unless we set 50 = 0. 

A bound for |ei| at steady state may be established when u,r] are uni- 
formly continuous functions of time. The uniform continuity of u, r], together 
with 6 e Coo, implies that ei = —9u + 77 is uniformly continuous, which, in 
turn, implies that ei + 5 is a uniformly continuous function of time. Because 
ei + 5 e £2) it follows from Barbalat's Lemma that jei+^j ^Oast^oo 
which by the expression for g in (8.4.33) implies that 

lim sup|ei(r)| <5o (8.4.35) 

The above bound indicates that at steady state the estimation error ei is 
of the order of the design parameter go which is an upper bound for |r7(t)|. 
Hence if go is designed properly, phenomena such as bursting (i.e., large 
errors relative to the level of the disturbance at steady state and over short 
intervals of time) that may arise in the case of the leakage modification and 
projection will not occur in the case of dead zone. 

Another important property of the adaptive law with dead-zone is that 
it guarantees parameter convergence, something that cannot be guaranteed 
in general by the unmodified adaptive laws when 77 = unless the input u 
is PE. We may establish this property by using two different methods as 
follows: 

The first method relies on the simplicity of the example and is not ap- 
plicable to the higher order case. It uses the property of V = 2Z and V < 
to conclude that V{t) and, therefore, 9{t) have a limit as t ^ 00. 
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The second method is apphcable to the higher order case as well and 
proceeds as follows: 
We have 

V = -(ei - J7)(ei + g) = -|ei - 7?||ei + g\ (8.4.36) 

where the second equality holds due to the choice of g. Because |ei + g\ = 
if |ei| ^ 50) it follows from (8.4.36) that 

V = -|ei - r?||ei + g\ < -\go - \i]\\\ei + g\ (8.4.37) 
Integrating on both sides of (8.4.37), we obtain 



inf Is-O - \v{t)\\ / ki +9\dT 
* Jo 



oo 



CX) 



< / \ei-r]\\ei+g\dT = V{0)-Vo, 



Because go > sup^ |^(^)|) it follows that ei+g £ Ci. We have \6\ < 'y\u\\ei+g\ 
which implies that 6 ^ Ci which in turn implies that 

/* 



lim / OdT = lim 9(1) - ^(0) 



exists and, therefore, 9(t) converges to some limit 9. 

The parameter convergence property of the adaptive law with dead zone 
is very helpful in analyzing and understanding adaptive controllers incorpo- 
rating such adaptive law. The reason is that the initially nonlinear system 
that represents the closed-loop adaptive control scheme with dead zone con- 
verges to an LTI one as t ^ oo. 

One of the main drawbacks of the dead zone is the assumption that an 
upper bound for the modeling error is known a priori. As we point out in 
later sections, this assumption becomes more restrictive in the higher order 
case. If the bound of the disturbance is under estimated, then the properties 
of the adaptive law established above can no longer be guaranteed. 

Another drawback of the dead zone is that in the absence of the distur- 
bance, i.e., r](t) = 0, we cannot establish that ei £ £2 and/or that ei(t) -^ 
as t ^ 00 (when n £ £00) unless we remove the dead-zone, i.e., we set go = 0. 
Therefore robustness is achieved at the expense of destroying some of the 
ideal properties of the adaptive law. 
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8.4.4 Dynamic Normalization 

In the previous sections, we design several modified adaptive laws to estimate 
the parameter 6* in the parametric model 

y = 0*u + 7] (8.4.38) 

when n £ £oo and rj is an unknown bounded signal that may arise because 
of a bounded output disturbance etc. 

Let us now extend the results of the previous sections to the case where 
u is not necessarily bounded and r] is either bounded or is bounded from 
above by \u\ i.e., \r]\ < ci\u\ + C2 for some constants ci,C2 > 0. In this case 
a normalizing signal such as m,^ = 1 + u^ may be used to rewrite (8.4.38) as 

y = 9*u + f] 
where x = — denotes the normalized value of x. Since with m,^ = 1 + u^ we 

m 

have y,u,fi E Coo, the same procedure as in the previous sections may be 
used to develop adaptive laws that are robust with respect to the bounded 
modeling error term fj. The design details and analysis of these adaptive 
laws is left as an exercise for the reader. 

Our objective in this section is to go a step further and consider the case 
where r] in (8.4.38) is not necessarily bounded from above by \u\ but it is 
related to u through some transfer function. Such a case may arise in the 
on-line estimation problem of the constant 6* in the plant equation 

y = e*{l + Ara{s))u + d (8.4.39) 

where Am(s) is an unknown multiplicative perturbation that is strictly 
proper and stable and d is an unknown bounded disturbance. Equation 
(8.4.39) may be rewritten in the form of (8.4.38), i.e., 

y = 0*u + r], r] = e* Amis)u + d (8.4.40) 

To apply the procedure of the previous sections to (8.4.40), we need to 
find a normalizing signal m that allow us to rewrite (8.4.40) as 

y = e*u + fi (8.4.41) 
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where y = ^,u= ^,fi= ^ <mdy,u,f) E Coo- Because of Am(s) in (8.4.40), 
the normaUzing signal given by m^ = 1 + n^ is not guaranteed to bound r] 
from above. A new choice for m is found by using the properties of the C25 
norm presented in Chapter 3 to obtain the inequality 

\f](t)\ < \e*\\\A^(s)\\25\\ut\\25 + \dit)\ (8.4.42) 



that holds for any finite 5 > provided A„i(s) is strictly proper and analytic 
' 2- 



in Re[s] > —2. If we now assume that in addition to being strictly proper, 



Am{s) satisfies the following assumption: 

Al. A„i(s) is analytic in Re[s] > —^ foi' some known Jq > 
then we can rewrite (8.4.42) as 

\v{t)\ < fioWuthso + do (8.4.43) 

where hq = \9*\\\Amis)\\2S„ and do is an upper bound for \d(t)\. Because 
fJ,o,do are constants, inequality (8.4.43) motivates the normalizing signal m 
given by 

m'^ = I + u"^ + WutWlso (8.4.44) 

that bounds both u, rj from above. It may be generated by the equations 

nig = —SoTTis + u^, ms{0) = 
n1 = nis, m^ = l + u^ + nl (8.4.45) 

We refer to iris = n^ as the dynamic normalizing signalin order to distinguish 
it from the static one given by rri^ = 1 + u^. 

Because m bounds n, rj in (8.4.40), we can generate a wide class of adap- 
tive laws for the now bounded modeling error term ?) = — by following the 
procedure of the previous sections. By considering the normalized equation 
(8.4.41) with m given by (8.4.45) and using the results of Section 8.3.1, we 
obtain 

= je'iu - JW0 (8.4.46) 



where 



- -- y-y . a 

m 



and w is the leakage term to be chosen. 
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As in the ideal case considered in Chapter 4, we can express (8.4.46) in 
terms of the normahzed estimation error 

y-y . n 
e = 5-, y = 6u 

to obtain 

e = jeu- jwe (8.4.47) 

or we can develop (8.4.47) directly by using the gradient method to minimize 

e^m^ wO'^ {y — Ou)"^ wO"^ 



m = ^^ + ^ = '-'hr-T^ + 



2 2 2m? 2 

with respect to 6. 

Let us now summarize the main equations of the adaptive law (8.4.47) 
for the parametric model y = 6*u + r] given by (8.4.40). We have 

= 'jeu — jwO, e= ^— , y = 9u 

rr? = l + u^ + nl, rus = n] (8.4.48) 

rhs = -5oms + u^, ms{0) = 



The analysis of (8.4.48) for the various choices of the leakage term w(t) is 
very similar to that presented in Section 8.4.1. As a demonstration, we 
analyze (8.4.48) for the fixed it- modification, i.e., w(t) = a. From (8.4.40), 
(8.4.48) we obtain the error equations 

e= ^, e = -feu--fae (8.4.49) 

where 9 = 9 — 9*. We consider the Lyapunov function 

27 
whose time derivative V along the solution of (8.4.49) is given by 

V =e9u- a99 = -(?n? + er] - a99 
By completing the squares, we obtain 

e^m^ n¥ rf a\9*? 

V < \ \ — - 

2 2 ^ 2m2 ^ 2 
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Because — £ £00 it follows that V,9 ^ Coo and em e S{^ + a). Because 

9 = 'jem— — ja6 and — e £00 we can establish as in Section 8.4.1 that 

9 ^ S{^ + a). The boundedness of 9,^,^ also implies by (8.4.49) that 
e, em, 9 e £00 • The properties of (8.4.48) with w = a are therefore given by 



(i) e, em, 9,9 ^ C^ 
{n)e,em,eeS{S + a) 



-00 

r,2 



In a similar manner, other choices for vj{t) and modifications, such as 
dead zone and projections, may be used together with the normalizing signal 
(8.4.45) to design adaptive laws that are robust with respect to the dynamic 
uncertainty r]. 

The use of dynamic normalization was first introduced in [48] to handle 
the effects of bounded disturbances which could also be handled by static 
normalization. The use of dynamic normalization in dealing with dynamic 
uncertainties in adaptive control was first pointed out in [193] where it was 
used to develop some of the first global results in robust adaptive control for 
discrete-time plants. The continuous-time version of the dynamic normal- 
ization was first used in [91, 113] to design robust MRAC schemes for plants 
with additive and multiplicative plant uncertainties. Following the work of 
[91, 113, 193], a wide class of robust adaptive laws incorporating dynamic 
normalizations are developed for both continuous- and discrete-time plants. 



Remark 8.4.2 The leakage, projection, and dead-zone modifications are 
not necessary for signal boundedness when u in the parametric model 
(8.4.1) is bounded and PE and rj £ C^o, as indicated in Section 8.3.1. 
The PE property guarantees exponential stability in the absence of 
modeling errors which in turn guarantees bounded states in the pres- 
ence of bounded modeling error inputs provided the modeling error 
term doesnot destroy the PE property of the input. In this case the 
steady state bounds for the parameter and estimation error are of the 
order of the modeling error, which implies that phenomena, such as 
bursting, where the estimation error assumes values larger than the 
order of the modeling error at steady state, are not present. The use 
of PE signals to improve robustness and performance is discussed in 
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subsequent sections. When u, r] are not necessarily bounded, the above 
remarks hold provided — e £00 is PE. 



8.5 Robust Adaptive Laws 

In Chapter 4 we developed a wide class of adaptive laws for estimating 
on-line a constant parameter vector 9* in certain plant parametric models. 
The vector 9* could contain the unknown coefficients of the plant transfer 
function or the coefficients of various other plant parameterizations. The 
adaptive laws of Chapter 4 are combined with control laws in Chapters 
6, 7 to form adaptive control schemes that are shown to meet the control 
objectives for the plant model under consideration. 

A crucial assumption made in the design and analysis of the adaptive 
schemes of Chapters 4 to 7 is that the plant model is an ideal one, i.e., it 
is free of disturbances and modeling errors and the plant parameters are 
constant for all time. 

The simple examples of Section 8.3 demonstrate that the stability prop- 
erties of the adaptive schemes developed in Chapters 4 to 7 can no longer 
be guaranteed in the presence of bounded disturbances, unmodeled plant 
dynamics and parameter variations. The main cause of possible instabili- 
ties in the presence of modeling errors is the adaptive law that makes the 
overall adaptive scheme time varying and nonlinear. As demonstrated in 
Section 8.4 using a simple example, the destabilizing effects of bounded dis- 
turbances and of a class of dynamic uncertainties may be counteracted by 
using simple modifications that involve leakage, dead-zone, projection, and 
dynamic normalization. In this section we extend the results of Section 8.4 
to a general class of parametric models with modeling errors that may arise 
in the on-line parameter estimation problem of a wide class of plants. 

We start with the following section where we develop several parametric 
models with modeling errors that are used in subsequent sections to develop 
adaptive laws that are robust with respect to uncertainties. We refer to such 
adaptive laws as robust adaptive laws. 
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8.5.1 Parametric Models with Modeling Error 
Linear Parametric Models 

Let us start with the plant 

y = Gois)il + A„,is))u + d (8.5.1) 

where 

a,M = ||i (8A2) 

represents the dominant or modeled part of the plant transfer function with 
Z{s) = bn-is""-^ + 6„_2s"-2 + ... + bis + bo and R{s) = s" + a„_is"-i + 
. . . + ais + fflo; Am(s) is a multiplicative perturbation and d is a bounded 
disturbance. 

We would like to express (8.5.1) in the form where the coefficients of 
Z(s),R{s) lumped in the vector 



0* = [bn-l,bn-2, ■ ■ ■ ,bo, a-n-l, an-2, • • • , OO 



T 



are separated from signals as done in the ideal case, where Am = 0,d = 0, 
presented in Section 2.4.1. From (8.5.1) we have 

Ry = Zu + ZArr,u + Rd (8.5.3) 

As in Section 2.4.1, to avoid the presence of derivatives of signals in the 
parametric model, we filter each side of (8.5.3) with -Aj:, where A(s) is a 
monic Hurwitz polynomial of degree n, to obtain 



R Z 

where 



A^=r+^- 



ZAm , R , 
Tim = -J^U + J^d 

is the modeling error term because of A^, d. If instead of (8.5.1), we consider 
a plant with an additive perturbation, i.e., 

y = Gois)u + Aais)u + d 

we obtain 

R Z 
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where 

Va = -7-AaU+ —d 

Similarly, if we consider a plant with stable factor perturbations, i.e., 

Nois) + Aii.s) 
y=Dois) + A,isf + ' 

where 

.. / X Z(s) ^ , , R{s) 

and A^O) -^o ^■I's proper stable transfer functions that are coprime, we obtain 



R Z 

where 



^y = ^n + ^. 



73 

r]s = Aiu - A2y + ij + A2)d 

Therefore, without loss of generality we can consider the plant parameteri- 
zation 

-y=-u + 7? (8.5.4) 

where 

7] = Ay{s)y + Au{s)u + di (8.5.5) 

is the modeling error with Ay,Au being stable transfer functions and di 
being a bounded disturbance and proceed as in the ideal case to obtain a 
parametric model that involves 6* . If we define 



as" a 



««-l(g) ««-l(g) 

Ms) ""' Ais) y 



where ai{s) = [s'\ s* , . . . ,s, 1] , as in Section 2.4.1, we can rewrite (8.5.4) 
in the form 

z = 0*^(f) + r] (8.5.6) 

or in the form 

y = 91^(^ + 7] (8.5.7) 

where Of = [Of ,ef - X^^ ,9^ = [6„_i,. . . ,6o]^, and 6*^ = K_i, . . . ,ao]^; 
A = [A„_i, . . . , Aq]^ is the coefficient vector of A(s) — s** = Xn-is"'~^ + - ■ ■+Xo- 
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The effect of possible nonzero initial conditions in the overall plant state- 
space representation may be also included in (8.5.6), (8.5.7) by following 
the same procedure as in the ideal case. It can be shown that the initial 
conditions appear as an exponentially decaying to zero term ryo, i.e., 

z = e*^(f) + r] + 7]o 

y = ef(l> + rj + r]o (8.5.8) 

where r]o is the output of the system 

uj = AcU), uj(0) = ujQ 
r]o = CqUJ 

Ac is a stable matrix whose eigenvalues are equal to the poles of Am(s) or 
Aa(s), or Ai(s) and A2(s) and A(s), and the degree of to is equal to the 
order of the overall plant. 

The parametric models given by (8.5.6) to (8.5.8) correspond to Param- 
eterization 1 in Section 2.4.1. Parameterization 2 developed in the same 
section for the plant with r] = may be easily extended to the case of 77 / 
to obtain 

y = Wm{s)efi; + ri 

z = W„^is)e*^i> + r] (8.5.9) 

where VFm(s) is a stable transfer function with relative degree 1 and tp = 
W-\s)cp. 

Parametric models (8.5.6), (8.5.7) and (8.5.9) may be used to estimate 
on-line the parameter vector 9* associated with the dominant part of the 
plant characterized by the transfer function Go(s). The only signals available 
for measurements in these parametric models are the plant output y and the 
signals (p, ip, and z that can be generated by filtering the plant input u 
and output y as in Section 2.4.1. The modeling error term r/ due to the 
unmodeled dynamics and bounded disturbance is unknown, and is to be 
treated as an unknown disturbance term that is not necessarily bounded. 
If, however, A^, A„ are proper then di,y,u £ £00 will imply that rj £ Coo- 
The properness of A^, A^j may be established by assuming that Go(s) and 
the overall plant transfer function are proper. In fact Ay,Au can be made 
strictly proper by filtering each side of (8.5.4) with a first order stable filter 
without affecting the form of the parametric models (8.5.6) to (8.5.9). 
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Bilinear Parametric Models 

Let us now extend the bilinear parametric model of Section 2.4.2 developed 
for the ideal plant to the plant that includes a multiplicative perturbation 
and a bounded disturbance, i.e., consider the plant 

y = Go{s){l + A„,{s))u + d (8.5.10) 

where 

Gois) = k,^ 
Rp{.s) 

kp is a constant, Rp{s) is monic and of degree n, Zp(s) is monic Hurwitz of 
degree m < n and kp, Zp, Rp satisfy the Diophantine equation 

RpQ + kpZpP = ZpA (8.5.11) 

where 

Q{s) = s"-^ + q'^an-2{s), P{s) = p^a„_i(s) 

and A(s) is a monic Hurwitz polynomial of degree 2n— 1. As in Section 2.4.2, 
our objective is to obtain a parameterization of the plant in terms of the 
coefficient vectors q,p of Q,P, respectively, by using (8.5.11) to substitute 
for Zp(s), Rp{s) in (8.5.10). This parameterization problem appears in direct 
MRAC where q,p are the controller parameters that we like to estimate on- 
line. Following the procedure of Section 2.4.2, we express (8.5.10) in the 
form 

RpH = kpZpU + kpZpAmU + Rpd 

which implies that 

QRpV = kpZpQu + kpZpQAmU + QRpd (8.5.12) 

From (8.5.11) we have QRp = ZpA — kpZpP, which we use in (8.5.12) to 
obtain 

Zp{A - kpP)y = kpZpQu + kpZpQAmU + QRpd 

Because Zp(s), A(s) are Hurwitz we can ffiter both sides of the above equa- 
tion with l/(ZpA) and rearrange the terms to obtain 

y = ^P^y + ^P^^ + ^P^j-u + ^4^c? 
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Substituting for P{s) = p^ an-i{s), Q{s) = s" ^ + q~''an-2{s), we obtain 






T"n-l(s) , ya„_2(s) , S 

p — ■ . s y + q — r^—u + 



n-l 



A(s) 



Ms) 



Hs) 



+ r] 



(8.5.13) 



where A(s) is a Hurwitz polynomial of degree nx that satisfies 2n — 1 > riA > 
n — 1 and 

-d (8.5.14) 



V 



'az~' 



A 



-u + 



is the modehng error resulting from Am,d. We can verify that ^^"^ , ^^ 
are strictly proper and biproper respectively with stable poles provided the 
overall plant transfer function is strictly proper. From (8.5.13), we obtain 
the bilinear parametric model 



y = W{s)p*{e*^<P + zo) + v 



^.5.15) 



where p* = kp, 



W{s) 



Ms) 



is a proper transfer function with stable poles and zeros and 



e* = [q\p']\ 



an-2is) al-i(s) 
A(.) "' A(.) y 



„n-l 



, ZO 



Ms) 



If instead of (8.5.10), we use the plant representation with an additive plant 
perturbation, we obtain (8.5.15) with 

V= ~/ (AaU + d) 

and in the case of a plant with stable factor perturbations Ai, A2 we obtain 
(8.5.15) with 



V 



AQ_ 

AZr, 



{Aiu-A2y) + 



AQ /i?; 



AZp V A 



+ A2U 



where A is now restricted to have degree n. If we assume that the overall 
plant transfer function is strictly proper for the various plant representations 
with perturbations, then a general form for the modeling error term is 



r] = AuU + Ay-y + di 



(8.5.16) 
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where Au(s), Ay(s) are strictly proper with stable poles and di is a bounded 
disturbance term. 

Example 8.5.1 Consider the following plant 

bis + bo 1 — /is 



y = e-^' 



S^ + OlS + Uq I + fIS 



where /i > 0,t > are small constants. An approximate model of the plant is 
obtained by setting fj,,T to zero, i.e., 

n / \ hs + bo 

y = Go{s)u = —- u 

s'' + ais + ao 

Treating Go(s) as the nominal or modeled part of the plant, we can express the 
overall plant in terms of Go{s) and a multiplicative plant uncertainty, i.e., 

y = -IT-, , (1 + ^m(s))w 

s^ + ais + ao 

where 

(e— -l)-Mg(l + e^-) 

^m(s) = — 

I + fiS 

Let us now obtain a parametric model for the plant in terms of the parameter vector 
6* = [bi,bo,ai,aa]^ . We have 

(s^ + ais + ao)y = {bis + bo)u + {bis + bo)Am{s)u 



s^y = {bis + bo)u - (ais + ao)y + (6is + &o)A„(s)u 
Filtering each side with 1^12)'^ ^® obtain 



where 



{s + 2y 



-y, 4> 



s 1 s 1 

"' 7 — r^TT9"' -7 — r^^y^-7 — r^^y 



(s + 2)2 '(s + 2)2 ' (s + 2)2^' (s + 2)2 



_ (feis + 60) [(e-"^ - 1) - fisjl + e-"^)] 
'^" (5 + 2)2 (1 + ^,) " V 

In the following sections, we use the linear and bilinear parametric models 
to design and analyze adaptive laws for estimating the parameter vector 6* 
(and p*) by treating r] as an unknown modeling error term of the form given 
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by (8.5.16). To avoid repetitions, we will consider the general parametric 
models 

z = W{s)e*^tP + 7] (8.5.17) 

z = W{s)p* [9*^^ + zo] + r] (8.5.18) 

7] = Au{s)u + Ay{s)y + di (8.5.19) 

where W(s) is a known proper transfer function with stable poles, z, ip, and 
zq are signals that can be measured and Au,Ay are strictly proper stable 
transfer functions, and di £ £oo- 

We will show that the adaptive laws of Chapter 4 developed for the 
parametric models (8.5.17), (8.5.18) with rj = can be modified to handle 
the case where ry / is of the form (8.5.19). 

8.5.2 SPR-Lyapunov Design Approach with Leakage 

Let us consider the general parametric model (8.5.17) which we rewrite as 

z = W{s){e*^^ + W-^{s)r]) 
and express it in the SPR form 

z = W{s)L{s){e*^c^ + T]s) (8.5.20) 

where 4' = L~\s)tp,ris = L~\s)W~\s)T] and L{s) is chosen so that W{s)L{s) 
is a proper SPR transfer function and L~^{s) is proper and stable. The 
procedure for designing an adaptive law for estimating on-line the constant 
vector 9* in the presence of the unknown modeling error term 

77, = L-\s)W-Hs){A^{s)u + Ay{s)y + di) (8.5.21) 

is very similar to that in the ideal case (r]s = 0) presented in Chapter 4. As 
in the ideal case, the predicted value z of z based on the estimate 6 of 6* 
and the normalized estimation error e are generated as 

z = W{s)L{s)e'^(t), e = z- z-W{s)L{s)enl (8.5.22) 

where m^ = 1 + n, is the normalizing signal to be designed. From (8.5.20) 
and (8.5.22), we obtain the error equation 

e = WL[-e'^(j) - tnl + r]s\ (8.5.23) 
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where 9 = 9 — 6*. Without loss of generahty, we assume that WL is strictly 
proper and therefore (8.5.23) may assume the following minimal state rep- 
resentation 

e = A^e + Bc[-e'^(p - en^ + r]s] 

e = Cje. 

Because Cj (sI-Ac)-^Bc = W(.s)L(s) is SPR, the triple (A^, B^, Cc) satisfies 
the following equations given by the LKY Lemma 

PcAc + AjPc= -qq^ - UcLc 

PcBc = L/C 

where Pc = Pj > 0, g is a vector, z^c > is a scalar and Lc = LJ > 0. The 
adaptive law is now developed by choosing the Lyapunov-like function 

where T = T^ > is arbitrary, and designing 9 = 9 so that the properties 
of V allow us to conclude boundedness for V and, therefore, e, 6. We have 

V = -^e'^qq'^e - ^e^ L^e - ¥ (pt - t^n^ + er?, + ¥t-^9 (8.5.24) 

If rjs = 0, we would proceed as in Chapter 4 and choose 9 = Tecp in order to 
eliminate the indefinite term —O^cpe. Because r]s ^ and rjs is not necessarily 
bounded we also have to deal with the indefinite and possibly unbounded 
term er]s in addition to the term —9'^4'e. Our objective is to design the 
normalizing signal m,^ = 1 + n^ to take care of the term erjs. 
For any constant a £ (0, 1) to be specified later, we have 

— e Ug + trjs = —t rig + erjg — at + at 

/I \ 2 2 I 2 2 2 

= —(1 — a)e Ug + ae — at m + erjg 

2 
/I \ 2 2 I 2 / Vs --,2 , Vs 

= —[l — a)eng + ae — a[em — ) + 



2am 4am2 

2 

< -(1 - a)e^n^ + ae^ + ^^ 
which together with |e| < |Cc||e| and 

-je L,e< ^(L,)|e| <-- e 
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imply that 

2 

V < -Ao|e|2 - (/3o - a)e^ - (1 - a)e^n'i + -^ - O'^ (pe + 0'^r-^0 
where Aq = ^Knin{Lc), /3o = Ao/|Ccp. Choosing a = 'min{^, Po), we obtain 

If we now design the normahzing signal m^ = 1 + n^ so that rjs/m G £00 (in 
addition to ip/m £ £00 required in the ideal case), then the positive term 
rJl/Aam? is guaranteed to be bounded from above by a finite constant and 
can, therefore, be treated as a bounded disturbance. 

Design of the Normalizing Signal 

The design of m is achieved by considering the modeling error term 

7?, = W-\s)L-\s)[^u{s)u + ^y{s)y + di] 
and the following assumptions: 

(Al) W~^{s)L~'^{s) is analytic in Re[s] > —-^ for some known (5o > 
(A2) Au,A.y are strictly proper and analytic in Re[s] > —^ 

Because WL is strictly proper and SPR, it has relative degree 1 which 
means that W~^L~^Au, W~^L~^Ay are proper and at most biproper trans- 
fer functions. Hence tjs may be expressed as 

r]s = ciu + C2y + Ai{s)u + A2(s)y + ^2 

where ci + Ai(s) = W-\s)L-\s)A^{s), C2 + A2(s) = W-\s)L-\s)Ay{s), 
d2 = W~^(s)L~^(s)di and Ai, A2 are strictly proper. Using the properties 
of the £2<5-iiorm from Chapter 3, we have 

\Vsit)\ < ci\uit)\ + \ym + \\Ms)hSo\\uthSo 
+ \\^2is)\\25o\\ythSo + \d2it)\ 
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Because ||Ai(s)||25(,, ||A2(s)||25o are finite and d2 G >Coo) it follows that the 
choice 

m2 = l + n2, n^ = ms + 0^(/> + n^ + y^ (8 5 25) 

rfis = -Sorris + u'^ + y'^, ms(0) = 

will guarantee that r]s/m £ Coo and (p/m £ £oo- 

With the above choice for m, the term ry^/(4am^) £ £oo which motivates 
the adaptive law 

e = re(j)-w{t)re (8.5.26) 

where T = T > is the adaptive gain and w{t) > is a scalar signal to 
be designed so that V < whenever V > Vq for some Vq > 0. In view of 
(8.5.26), we have 

V <-Xo\e\'^--e^nl-we'^6+^Kj (8.5.27) 

which indicates that if w is chosen to make V negative whenever \9\ ex- 
ceeds a certain bound that depends on rj^ / (Aam'^) , then we can establish 
the existence of Vq > such that V < whenever V >Vo. 

The following theorems describe the stability properties of the adaptive 
law (8.5.26) for different choices of w{t). 

Theorem 8.5.1 (Fixed a Modification) Let 

w{t) = a > 0, Vt > 

where a is a small constant. The adaptive law (8.5.26) guarantees that 

(i) e,ee/:oo 

(ii) t,tns,0 &S{(j + rjl/m'^) 

(iii) In addition to properties (i), (ii), ifns,4>,(j) £ ^oo, and (p is PE with level 
ao > that is independent of tjs, then the parameter error 6 = 9 — 6* 
converges exponentially to the residual set 



D^ = {6\\6\ <c{a + fj)} 
where c £ TZ'^ depends on ao and f) = supj \r]s\. 
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Proof We have 

-cre^o < -a{¥()- \e\r\) < -\W + \\n 

and 

-o¥e<-\\ef^\r\^ 

Hence, for w = ct, (8.5.27) becomes 

,2„2 „ „2 |fl*|2 

F<-AoH^-^-||e? + co^ + a^ (8.5.28) 

where Cq = j^ or 

l><-/3y + cory„ + a^ + /?f^ + ^^^VAo|ep-||0? (8.5.29) 

where r\rn = sup^ ^ and /3 is an arbitrary constant to be chosen. 

Because e^Pce+¥v~H < \e\'^X„iaxiPc) + \0\'^Knax{T~'^), it follows that for 

2Ao a 



j3 = min 
.5.29) becomes 






V < -l3V + caf]m + (y- 

Hence, for V^ > Vo = ^"''"'2/3'^ — ^' ^ ^ which implies that V G £00 and therefore 

e,e,9,9 e Coo- 

We can also use -a0^e < -f 16*12 + ||0*|2 and rewrite (8.5.27) as 

V < -Xo\ef - !M _ ||e|2 + ,„^ + -|r|2 (8.5.30) 

Integrating both sides of (8.5.30), we obtain 

^* (aoI^I^ + ^ + ^\9\'^ dr < £ (co^ + a^) dr + V{to) - V{t) 

\/t > to and any to > 0. Because V G £00 and e = Cje, it follows that e,e, erig, 
\/cr|6^| € S{a + ril/rn^). Using the property -^ e £00, it follows from (8.5.26) with 
w = a that 

|^|'<c(|em|2 + a|0|2) 

for some constant c > and, therefore, e, en^, -v/frl^l ^ '^((T + rH/m^) and 6* G £00 
imply that em and ^ G S{a + rH/rn^). 
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To establish property (iii), we write (8.5.23), (8.5.26) as 
e = A^e + B^{-9'^<f>-enl) + B^r], 

e = re(i)-are (8.5.31) 

e = Cje 

Consider (8.5.31) as a linear time- varying system with rjs, <t6 as inputs and e, 9 as 
states. In Section 4.8.2, we have shown that the homogeneous part of (8.5.31) with 
rys = 0, cr = is e.s. provided that rig, 0,0 G £00 and (j) is PE- Therefore, the state 
transition matrix of the homogeneous part of (8.5.31) satisfies 

mtM)\\ < Pie-^^^'-'°^ (8.5.32) 

for any t,to > Q and some constants /3i,/32 > 0. Equations (8.5.31) and (8.5.32) 
imply that 9 satisfies the inequality 

1^1 < Poe-^^' + p[ ! e-P-^'-^\\ijs\ + (T\0\)dT (8.5.33) 



for some constants f3o, Pi > 0, provided that the PE property of (j) is not destroyed 
by r]s ^ 0. Because 6 G C^o, which is established in (i), and cp G C^o, it follows from 
(8.5.33) that 

\0\<f3oe-^-'+^{n + cTsup\9\) 

P2 t 

where 77 = supj |?7s(t)|. Hence, (iii) is proved by setting c = ^7TT.aa;{l,supt |^|}. H 



Theorem 8.5.2 (Switching a) Let 

' if \e\ < Mo 

w{t) = as, cTs = I (£ - 1)'° ao if Mo < \e\ < 2Mo 

. ao if\e\>2Mo 

where qo > 1 is any finite integer and (7o,Mo are design constants with 
Mq > 1^*1 and ao > 0. Then the adaptive law (8.5.26) guarantees that 

(i) ^,ee£oo 

(ii) t,tns,0 ^S{ril/m'^) 

(iii) In the absence of modeling errors, i.e., when rjs = 0, property (ii) can 
he replaced with 
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(ii') e,ens,9 £ £2- 

(iv) In addition, if ns,(p,(p £ £00 and (j) is PE with level ao > that is 
independent of rjs, then 

(a) 6 converges exponentially to the residual set 

Ds = {e\ \e\ < c{ao + f,)} 

where c £ IZ'^ and r) = sup^ \ris\ 

(b) There exists a constant fj* > such that for fj < fj* , the parameter 
error 6 converges exponentially fast to the residual set 

Ds = {e\\9\<cfi} 

Proof We have 

asFe = as{\d\^ - 9*^9) > a,\9\{\9\ - Mq + Mq - \9*\) 
Because cFs{\9\ - Mq) > and Mo>\9*\, it follows that 

aj'^9 > a,\9\{\9\ - Mq) + (y,\9\iMo - \9*\) > a,\9\{Mo - \9*\) > 



The inequality (8.5.27) for V with w = a^ can be written as 

V<-Xo\e\^-^^-'ys9'^9 + co^ (8.5.35) 

2 m^ 

Because for \9\ = \9 + 9*\> 2Mo, the term -as9^9= -(7^9'^ 9 < -f\9\'^+ f\9*\'^ 
behaves as the equivalent fixed-CT term, we can follow the same procedure as in the 
proof of Theorem 8.5.1 to show the existence of a constant Vq > for which V <Q 
whenever V^ > Vo and conclude that V, e, e,9,9 e Loo- 

Integrating both sides of (8.5.35) from fo to t, we obtain that e, e, en,,, em, 
\Jgs9'^9 e S{'ql/m'^). From (8.5.34), it follows that 

(tI\9\' < C2aJ^9 

for some constant C2 > that depends on the bound for ctq |^|, and, therefore, 

\9\^ <c{\em\'^ + as9'^9), for somec G 7e+ 
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Because em, \l agd^ Q e S{ril/7in?), it follows that 6 e S{rj1/m?). 

The proof for part (iii) follows from (8.5.35) by setting rjs = 0, using —cTsO^O < 
and repeating the above calculations for rjs = 0. 

The proof of (iv)(a) is almost identical to that of Theorem 8.5.1 (iii) and is 
omitted. 

To prove (iv)(b), we follow the same arguments used in the proof of Theorem 
8.5.1 (iii) to obtain the inequality 

\0\ < /3oe-^^*+/3; / e-^=(*-^)(|77,| + a,|0|)dT 



< (3ne-^^'+(^f]+0'i f e-^-^'~^^as\9\dT (8.5.36) 

P2 Jo 



From (8.5.34), we have 



-#l < J^\-se^(^ < W^\-M \0\ (8.5.37) 



1^1 < Poe''^'' + ^V + /?! / e-''=(*-^V,|6'| \d\dT (8.5.38) 



Therefore, using (8.5.37) in (8.5.36), we have 

P2 Jo 

where (3^ = j, \g,, ■ Applying B-G Lemma III to (8.5.38), it follows that 

Note from (8.5.34), (8.5.35) that y^(Js\e\ e S{7fjm'^), i.e., 

ft 

<Ts\0\dT < Cilf{t - to) + Co 



'to 

Vt > to > and some constants co, ci. Therefore, 

1^1 < ^ie-"(*-*") +^2'? / e-"(*-^)dr (8.5.40) 

Jto 
s2 



where a = (32 — p2'^i'n ^^'^ /3i,/92 > are some constants that depend on cq and 
the constants in (8.5.39). Heno 
a > and (8.5.40) implies that 



the constants in (8.5.39). Hence, for any r] G [0,7/*), where rj* = . / „ we have 



a 
for some constant c and for all t > fo ^ 0. Therefore the proof for (iv) is complete. 

D 
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Theorem 8.5.3 (e-Modification) Let 

w(t) = \em\h'Q 

where vq > is a design constant. Then the adaptive law (8.5.26) with 
w{t) = \tm\vQ guarantees that 

(i) e,ee£oo 

(ii) e, ens, 6 e S{vo + rjl/rn^) 

(iii) In addition, if ns,4',(l) £ ^oo o-nd (p is PE with level oq > that is 
independent of rjs, then 9 converges exponentially to the residual set 

D, = {e\\e\<c{uQ + f,)] 

where c e TZ'^ and f) = sup^ \ris\. 

Proof Letting w{t) = |em|i^o and using (8.5.26) in the equation for V given by 
(8.5.24), we obtain 

2 m 

Because -^6* < -^^ + Kf, it follows that 

V < -2Ao|ep - e^nl - \em\ L^ - ^ - ^^o) (8.5.41) 

\ 2 m 2 / 

where Aq = '^'^ "^" " , which implies that for large |e| or large \0\,V < 0. Hence, 
by following a similar approach as in the proof of Theorem 8.5.1, we can show the 
existence of a constant Vq > such that for V > Vq, V < 0, therefore, V, e, e, 9, 

G Ceo- 

Because |e| > T^j-r, we can write (8.5.41) as 

T>^ \l|2 a2 22, 2/11 2\ 22 i i^' 

y < — Ao|e| — poe — e n^ + aoe (l + n^) — aoe m — \eni\i^o—— 

m 2 

by adding and subtracting the term aoe^m'^ = aoe^{l + n^), where /3o = T7772 and 
ao > is an arbitrary constant. Setting ag = mm(l,/3o), we have 

V < -Ao|e|2 - aoe^m^ + |em|^ + \em\^-^iyo 

m 2 
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By completing the squares and using the same approach as in the proof of The- 
orem 8.5.1, we can estabUsh that e,ens,em G S{h'o + 'ql/m?), which, together 
with 1^1 < ||r|||em|— + z^o||r|| k^^H^I ^ c\tm\ for some c G 7^"*", imphes that 

The proof of (iii) is very similar to the proof of Theorem 8.5.1 (iii), which can 
be completed by treating the terms due to rjs and the e-modification as bounded 
inputs to an e.s. linear time-varying system. D 

Remark 8.5.1 The normalizing signal m given by (8.5.25) involves the dy- 
namic term wis and the signals <p, u, y. Under some conditions, the 
signals (p and/or u, y do not need to be included in the normalizing 
signal. These conditions are explained as follows: 

(i) If = H{s)[u,y]^ where H{s) has strictly proper elements that are 
analytic in Re[s] > —So/2, then -^ /^ e C^o and therefore the term 
(j)^ (p in ths expression for n^ can be dropped. 

(ii) If W{s)L{s) is chosen to be biproper, then W~^L~^Au,W~^L~^Ay 
are strictly proper and the terms u^, y^ in the expression for n^ can be 
dropped. 

(iii) The parametric model equation (8.5.20) can be filtered on both sides 
by a first order filter ^^V where /o > -|- to obtain 

*T, 



Zf = W{s)L{s){e*^<t>f + r,f) 



^ /o 



where Xf = jirr^ denotes the filtered output of the signal x. In this 
case 

Vf = L-\s)W-\s)^^[Au{s)u + Ay{s)y + di] 
s + Jo 

is bounded from above by m^ given by 

2 1 I 2 2 

m = 1 + rig, rig = rUg, 

rris = -dovfis + u^ + y'^, ms(0) = 

The choice of m is therefore dependent on the expression for the mod- 
eling error term r] in the parametric model and the properties of the 
signal vector <p. 
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Remark 8.5.2 The assumption that the level oq > of PE of (p is indepen- 
dent of r]s is used to guarantee that the modeling error term r]s does 
not destroy or weaken the PE property of (p. Therefore, the constant 
(32 in the bound for the transition matrix given by (8.5.32) guaranteed 
to be greater than zero for ?]s = is not affected hy rjg ^ 0. 

8.5.3 Gradient Algorithms with Leakage 

As in the ideal case presented in Chapter 4, the linear parametric model 
with modeling error can be rewritten in the form 

z = e*^(p + r], T] = A,^{s)u + Ay{s)y + di (8.5.42) 

where (p = W{s)^Jj. The estimate z of z and the normalized estimation error 
are constructed as 

„T z — z z — B^ (p 
z = e^<P, t = — ^ = ^ 8.5.43 

where 9 is the estimate of 9* and m^ = 1 + n^ and Ug is the normalizing 
signal to be designed. For analysis purposes, we express (8.5.43) in terms of 
the parameter error 9 = 9 — 9*, i.e., 

e = ^^ 8.5.44 

If we now design m so that 

m^m^^oo ^ (Al) 

then the signal em is a reasonable measure of the parameter error 9 since 
for any piecewise continuous signal cp and rj, large em, implies large 9. 

Design of the Normalizing Signal 

Assume that Au{s), Ay(s) are strictly proper and analytic in Re[s] > —Sq/2. 
Then, according to Lemma 3.3.2, we have 

\vit)\ < l|A«(s)||25oht||25o + l|Aj/(s)||25ol|yt||25o + Nllb^o 
which motivates the following normalizing signal 

m = l + rig, rig = TTis + (p </• 

ihs = -Squis + u^ + y^, ms(0) = (8.5.45) 
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that satisfies assumption (Al). If (p = H{s)[u,y] where all the elements of 
H{s) are strictly proper and analytic in Re[s] > —-§■, then ^ /^ £ £00 and 
the term (j) (p can be dropped from the expression of n^ without violating 
condition (Al). 

If instead of being strictly proper, A„, Aj^ are biproper, the expression 
for n1 should be changed to 

to satisfy (Al). 

The adaptive laws for estimating 9* can now be designed by choosing 
appropriate cost functions that we minimize w.r.t. 9 using the gradient 
method. We start with the instantaneous cost function 

mt) = ^ + "^9-9 = ^'-'"f + "^9-9 
^ ' ' 2 2 2m? 2 

where w{t) > is a design function that acts as a weighting coefficient. 
Applying the gradient method, we obtain 

9 = -VVJ = Vt(t)-wVe (8.5.46) 

trr? = z - 0'^ (j) = -¥ (f) + rj 

where V = F^ > is the adaptive gain. The adaptive law (8.5.46) has the 
same form as (8.5.26) except that e and <p are defined differently. The weight- 
ing coefficient w{t) in the cost appears as a leakage term in the adaptive law 
in exactly the same way as with (8.5.26). 

Instead of the instantaneous cost, we can also use the integral cost with 
a forgetting factor /3 > given by 

where w(t) > is a design weighting function. As in Chapter 4, the appli- 
cation of the gradient method yields 

^ = -rV J = r r e-^(-^) Kr)-^J(t)^(r)]^ ^^ _ ^^^ 
Jo m\T) 
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which can be implemented as 

e = -r{Re + Q)-rw9 

R = -fjR+riL.^ R{0) = (8.5.47) 

Q = -(3Q-% g(o) = o 

where R G 7?,"^", Q e TZ"^^^ and n is the dimension of the vector cj). 

The properties of (8.5.46), (8.5.47) for the various choices of w{t) are 
given by the following Theorems: 

Theorem 8.5.4 The adaptive law (8.5.46) or (8.5.47) guarantees the fol- 
lowing properties: 

(A) For the fixed-cr modification, i.e., w{t) = it > 0, we have 

(i) e, ens, 6, 9 e Coo 
(ii) e,tns,0 ^S{a + rf/m^) 

(iii) If ns,4> £ Coo and 4> is PE with level ao > independent of rj, 
then 6 converges exponentially to the residual set 



D, = [e\\e\<c{a + n)} 



where 7] = sup^ ^^Wr and c> is some constant. 



(B) For the switching-ir modification, i.e., for w{t) = as where as is as 
defined in Theorem 8.5.2, we have 



(i) e,ens,0,6 e Coo 

(ii) t,tns,6 E S{rf'/m^) 

(iii) In the absence of modeling error, i.e., for r] = 0, the proper- 
ties of (8.5.46), (8.5.47) are the same as those of the respective 
unmodified adaptive laws (i.e., with w = 0) 



8.5. ROBUST ADAPTIVE LAWS 595 

(iv) If Hs^cj) £ ^oo oLnd (p is PE with level ao > independent of rj, 
then 

(a) 9 converges exponentially fast to the residual set 

Ds = {e\\e\<c{ao + fi)} 

where c> is some constant. 

(b) There exists an fj* > such that if f) < fj* , then 9 converges 
exponentially to the residual set Ds = \0 \6\ < cfj > . 

Proof We first consider ttie gradient algorithm (8.5.46) based on the instantaneous 
cost function. The proof of (i), (ii) in (A), (B) can be completed by using the 
Lyapunov-like function V{0) = 2— L — z and following the same procedure as in the 
proof of Theorems 8.5.1, 8.5.2. 

To show that the parameter error converges exponentially to a residual set for 
persistently exciting (f), we write (8.5.46) as 

■e = -r^e+'^-w{t)re (8.5.48) 

In Section 4.8.3 (proof of Theorem 4.3.2 (iii)), we have shown that the homogeneous 
part of (8.5.48) with rj = and w = is e.s., i.e., the state transition matrix of the 
homogeneous part of (8.5.48) satisfies 

for some positive constants /3i,/32- Viewing (8.5.48) as a linear time- varying system 
with inputs — , w9, and noting that — G Coo and the PE level ao of (f> is independent 
of ?7, we have 

1^1 < /?oe-''=* + f3[ f e-''^(*-^) 0-^ + \w{T)e\\ dr (8.5.49) 

for some constant f^i > 0. For the fixed cr-modification, i.e., w(t) = a, (A) (iii) 
follows immediately from (8.5.49) and 9 G Coo- For the switching a-modification, 
we write 

1^1 < /3oe-'^=* + 4^ + /Sl / e-^^^'^^^wiT)6\dT (8.5.50) 

P2 Jo 

To obtain a tighter bound for 9, we use the property of as to write (see equation 
(8.5.34)) 

^^I^I^^^M^^M^^^I^II^I (8.5.51) 
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Using (8.5.51) in (8.5.50), we have 



-ftt , [hlj. r" I p-/32(t-r)^ 



\0\ < Poe-"'' + ^ + f3i e-'^^^'-^V.I^I |0|dr (8.5.52) 

P2 Jo 

with Pi = J, _|fl«| ■ Applying B-G Lemma III, we obtain 

(8.5.53) 

A 

2~ 

adaptive law given by (8.5.46) with w = as, we have 



Now consider the Lyapunov function V{0) = ^-J^ — "_ Along the solution of the 



V = JI1^ + !L ^Zl.,^0T0^,^_,^0To (8.5.54) 

for some constant c > 0, where the second inequality is obtained by using the 
properties that 9, — (£ Coo- Equations (8.5.51) and (8.5.54) imply that 

which, together with the boundedness of V, leads to 

t 
(Ts\0\dT <Cif]{t-to) + Co (8.5.55) 

for all t > to ^ and for some constants Ci,Co. Using (8.5.55) in (8.5.53), we have 

1^1 < ^oe~"^*"*"^ + PiV f e-"(*"^)dr (8.5.56) 

Jto 

where a = (32 — Pi cifj. Therefore for 77* = „ and f] < fj* , we have a > and 

Pi ^1 

a 

where e^ is an exponentially decaying to zero term and the proof of (B)(iv) is 
complete. 

The proof for the integral adaptive law (8.5.47) is different and is presented 
below. From (8.5.47), we can verify that 

Q{t) = -R{t)0* - fe-Pi^-r)^^i^r)dr 
Jo "^ (t) 
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and therefore 



/o 






.5.57) 



Let us now choose the same V^(^) as in the ideal case, i.e., 

Vii) - ^ 

Then along the solution of (8.5.57), we have 

ft 



V 



3T 



Re- 



VRe + ¥(t) g-/3(«-r) v^v- /v ; ^^_^gTg 

Jo "T- (t) 

1 



e-f^i^-r)Ililldr 



<jFe 



m?{T) J \Jo m2(r) 

(8.5.58) 

where the inequality is obtained by applying the Schwartz inequality. Using 

(F(t)0(T))2 = F(t)0(r)0T(r)e'(f) 

and the definition of the norm || • \\2S, we have 



V <-e' Re + {e' Re)i {^)t 



m 



2/3 



Using the inequality —a^ + ab< —\-\-^ 

e^RO 1 

V < ^ + - 



we obtain 

)^ 

2/3/ 



m 



•jd'^d 



.5.59) 



Let us now consider the following two choices for w: 

(A) Fixed a For w = cr, we have -a6^6 < -f |^P + f |6l*p and therefore 



e^Re a,-,y cr,,,,. 1 
2 2' ' 2' ' 2 



i^h 



2/3 



.5.60) 



Because R = R > 0, cr > and ||(^)t||2n ^ c^ for some constant Cm > 0, it 

follows that y < whenever V{0) > Vq for some Vq > that depends on fj, a and 
|0*p. Hence, y, (? G Coo which from (8.5.44) implies that e,em,ens G Coo- Because 
R,Q E Coo and 9 G £00, we also have that G Coo- 
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Integrating on both sides of (8.5.60), we obtain 

^ ^ '¥Re + a\e\^)dT < v{to)-v{t) + l f (7\e*\^dT 






1 /• A ,-Pir-s, RilLdsdr 



2 A„ io "^^(s) 

By interchanging the order of the double integration, i.e., using the identity 

f f f{T)g{s)dsdT = f f f{T)g{s)dTds+ f" f f{T)g{s)dTds 

J to JO J to J s Ja Jta 

we establish that 



where c = supj ;^T7jy , which together with V G Ceo imply that 

It can also be shown using the inequality —a9^d < — f |^P + f |6'*p that v^l^l ^ 
S{a + if' /m^). To examine the properties of e, eUs we proceed as follows: We have 



—e^m = 2¥Re + ¥R0 

dt 



-2FRYRe + 2FRV / 

-'0 



^,,(,„,)0(rh(r)^^ 



?7i2(t) 

-2(T(FRTe - [39^ Rd + ^^ t 

where the second equality is obtained by using (8.5.57) with w = a and the expres- 
sion for R given by (8.5.47). Because e = ^ — t-^, it follows that 



„ RO = -26' RTRe + 2e' RT 6"^^'"^-' ^^ i, dr 
dt Jo m''(T) 

-2(jFRVe - (iFRO + (em - ^f 

m 

Using {em — ^)^ > ^-p ^, we obtain the inequality 



2 9 



< l^-T^^g- + 2e'Ti?r7?e' - 29^ RT f e-^(*-^) ^^4^^^ 
dt Jq m^(T) 

2 

+ 2a9'^ RT9 + pF R9 + ^ (8.5.62) 
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Noting that 



RT / e 

/o 



?71^(t) 



< \Frt\^ ■ 



-f3(t~ 






(ir / e 



-/3(t-r) 



?tt,2(t) 



rfr 



where the last inequaUty is obtained by using 2ab < a? -\- b"^ and the Schwartz 
inequahty, it follows from (8.5.62) that 

^-^ < ^e'^Re + 2FRTRe + 2aFRTe + (5¥Re 

Jo mP-{T) Jq ■mP-{T) m? 

Because i??^, y^|0| G iS((T + rf'/m?) and —,0,R(£ Coo, it follows from the above 
inequality that e, eUg, em G S{a + if' /m^). Now from (8.5.57) with w = cr we have 



1 ,, . 1 



1^1 < \\TR-^\\\R-^e\ + a\\T\\\e\ 

m-'yTj 



m?[T) 



dT 



which can be used to show that G S{(7 + ry^/m^) by performing similar manipu- 
lations as in (8.5.61) and using \/cr|0| G S{(J + if' /m?). 

To establish the parameter error convergence properties, we write (8.5.57) with 
w = fj as 



e=-TR{t)e + T I e"'3(*-)^ 



dT - TaO 



.5.63) 



In Section 4.8.4, we have shown that the homogeneous part of (8.5.63), i.e., 6 = 

—TR[t)9 is e.s. provided that 4> is PE. Noting that j„ Q-Pi't-'^) ^dr < cfj for some 

constant c > 0, the rest of the proof is completed by following the same procedure 
as in the proof of Theorem 8.5.1 (iii). 



(B) Switching a For w(i) = Os we have, as shown in the proof of Theorem 8.5.2, 



that 



(y,¥d>a,\Q\{Mo-\e*\)>^, i.e., o,\d\<G, 



Mn 



.5.64) 



and for \B\ = \B + d*\> 2Mq we have 



-M^^<-fl^? + f|r|2 
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Furthermore, the inequality (8.5.59) with w{t) = a,, can be written as 

- cFsO^e (8.5.65) 



e' RO 1 

V < h - 

2 2 



m 



2/3 



Following the same approach as the one used in the proof of part (A), we can 
show that V^ < for V > Vq and for some Vq > 0, i.e., V G Coo which implies that 
e, 9, eus G Coo- Integrating on both sides of (8.5.65), we obtain that R^O, \/ (TsO^O e 
S{rf' /m?). Proceeding as in the proof of part (A) and making use of (8.5.64), we 
show that e,eng G S{Tf' /m^). Because 

where ci G TZ^ depends on the bound for (To|0|, we can follow the same procedure 
as in part (A) to show that 6 G S{'rf' /m"^). Hence, the proof for (i), (ii) of part (B) 
is complete. 

The proof of part (B) (iii) follows directly by setting rj = Q and repeating the 
same steps. 

The proof of part (B) (iv) is completed by using similar arguments as in the 
case of part (A) (iii) as follows: From (8.5.57), we have 

e = -TR{t)d + r / e^'^f*"^) —IdT - TwO, w = as (8.5.66) 

Jo 'm 

In Section 4.8.4, we have proved that the homogeneous part of (8.5.66) is e.s. if 

(p G Coo and (j) is PE. Therefore, we can treat (8.5.66) as an exponentially stable 

linear time-varying system with inputs (7g9, L e^^^^~'^' ^dr. Because '-^ < fj and 

— G Coo, we have 

/o rn^ 

for some constant c > 0. Therefore, the rest of the parameter convergence proof 
can be completed by following exactly the same steps as in the proof of part (A) 
(iii). D 



e-Modification 

Another choice for w{t) in the adaptive law (8.5.46) is 

w(t) = \em\h'Q 

where i/q > is a design constant. For the adaptive law (8.5.47), however, 
the e-modification takes a different form and is given by 



CT] 



w{t) = iyo\\e{t,-)m{-)t\ 



2/3 
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where 



Az{T)-6^{t)^{ 



T 



e(i> t) = 2r~\ ' ^ - ^ 



and 



<t,-)m{-)\\w= / e-^^'-^h\t,r)m'{r)dT 



ft 
'0 

We can verify that this choice of w{t) may be implemented as 

wit) = iro + 29'^Q + e'^R9)'2uo 

z^ 
ro = -pro + -^, ro(0) = (8.5.67) 

The stability properties of the adaptive laws with the e-modification are 
given by the following theorem. 

Theorem 8.5.5 Consider the adaptive law (8.5.46) with w = \tm\uQ and 
the adaptive law (8.5.47) with w{t) = uoWe^t, ■)m(-)\\2i3. Both adaptive laws 
guarantee that 

(i) e,ens,6,9 e Coo- 
(ii) t,ens,9 ES{vQ + rf/m^). 

(iii) If ns,(f) e Coo o-nd (p is PE with level ag > that is independent of rj, 
then 9 converges exponentially fast to the residual set 

D, = {9\\9\<c{uo + fi)} 

where c > and f) = sup^ ^ . 

Proof The proof of (i) and (ii) for the adaptive law (8.5.46) with w{t) = fo|em| 
follows directly from that of Theorem 8.5.3 by using the Lyapunov-like function 
V = ^—^^. The time derivative V oi V = ^1^-^ along the solution of (8.5.47) 
with wit) = j^olk(^: •)'™(')ll2/3 becomes 

V = -F[Re + Q]-wFe 



-F{t) 



e 



^(,_,) ^{Ty£^mT)^^{T)\^^ 







m?{T) 



Ut,-)m{-)\\^pvo0' e 
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Using e(i,T)m2(r) = z(t) - 0^(i)0(r) = -9'^ {t)(j){T) + '^{t) we have 



V 



-P(t' 



s{t,T)[e{t,r)m\T) - r^{T)]dT - \\e{t,-)m{-)\\^f,i.oO'' 



< 



Mt,-)m{-)\\,^ +||,(t,.)^(.)||^^ (^), .\\e{t,-)m{-)\\,^i.oO 



2/3 



lk(^-M-)ll 



2/3 



lk(^,-M-)ll 



2/3 



i^h 



2/3 



where the second term in the inequaUty is obtained by using the Schwartz inequality. 
Using —9 9 < ~"2 ~'~'2~ ^^'^ ^^^ same arguments as in the proof of Theorem 8.5.3, 
we establish that V,e,ens,0,9 G £oo- From (8.5.59) and w{t) = i^o\\e{t, ■)m{-)\\2/3, 
we have 



V < 



< 



9^R9 1 
9'^R9 1 



m 
m 



2/3 



(e(i,-)"^(-))*ll2/3'^oe'^^ 
(e(i,.M.))*|l2/,'^o(^-^^ 



2/3/ ''^ ' 2 2 

Integrating on both sides of the above inequality and using the boundedness of V , 

em and (8.5.61) we can establish that i?2 0, ^JVq f ||(e(i, T)m{TJ)t\\2g ) \9\ (£ S{h'o + 

if' /m"^). Following the same steps as in the proof of Theorem 8.5.3, we can conclude 
that e, eris, 9 G S{vt) + rf' /m^) and the proof of (i), (ii) is complete. 

Because em, ||e(i, ■)rn{-)t\\2i3 G £00, the proof of part (iii) can be completed by 
repeating the same arguments as in the proof of (A) (iii) and (B) (iv) of Theo- 
rem 8.5.4 for the ct- modification. D 



8.5.4 Least-Squares with Leakage 

The least-squares algorithms with leakage follow directly from Chapter 4 by 
considering the cost function 

I 2m2(r) 



jm = /■,-...-.. w-)-^:(')/w)% „,(.)<,T(,),(,,L, 



+ 



\e-^\e - eo)'^Qo{9 - Bo) 



(8.5.68) 



where /3 > is the forgetting factor, w{t) > is a design weighting function 
and m,(t) is as designed in Section 8.5.3. Following the same procedure as 
in the ideal case of Chapter 4, we obtain 



e = P{e(f> - we) 



.5.69) 
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P = f3P-P^P^ P(0) = Po = Qo' (8-5.70) 

where Pq = Pj > and (8.5.70) can be modified when /3 = by using 
covariance resetting, i.e., 

P = -P^P, P{tt) = Po = Pol (8.5.71) 

where tr is the time for which \min{P{t)) < pi for some po > pi > 0. When 
/3 > 0, (8.5.70) may be modified as 

p=i (3P-P^P if\\Pm<Ro (8.5.72) 

[ otherwise 

with ||Po|| ^ ^0 for some scalar Rq > 0. 

As we have shown in Chapter 4, both modifications for P guarantee that 
P,P~^ e Coo and therefore the stability properties of (8.5.69) with (8.5.71) 
or (8.5.72) follow directly from those of the gradient algorithm (8.5.46) given 
by Theorems 8.5.4, 8.5.5. These properties can be established for the various 
choices of the leakage term w(t) by considering the Lyapunov-like function 
V{6) = ^—^ — - where P is given by (8.5.71) or (8.5.72) and by following the 
same procedure as in the proofs of Theorem 8.5.4 to 8.5.5. The details of 
these proofs are left as an exercise for the reader. 

8.5.5 Projection 

The two crucial techniques that we used in Sections 8.5.2 to 8.5.4 to develop 
robust adaptive laws are the dynamic normalization m and leakage. The 
normalization guarantees that the normalized modeling error term r]/m is 
bounded and therefore acts as a bounded input disturbance in the adaptive 
law. Since a bounded disturbance may cause parameter drift, the leakage 
modification is used to guarantee bounded parameter estimates. Another 
effective way to guarantee bounded parameter estimates is to use projec- 
tion to constrain the parameter estimates to lie inside some known convex 
bounded set in the parameter space that contains the unknown 9* . Adaptive 
laws with projection have already been introduced and analyzed in Chapter 
4. In this section, we illustrate the use of projection for a gradient algorithm 
that is used to estimate 6* in the parametric model (8.5.42): 

z = e*^(j) + r], r] = Au{s)u + Ay{s)y + di 
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To avoid parameter drift in 9, the estimate of 6*, we constrain 6 to lie 
inside a convex bounded set that contains 9*. As an example, consider the 
set 

V = {9\g(9) = 9'^ 9 - M^ < o} 

where Mq is chosen so that Mq > |^*|. The adaptive law for 9 is obtained 
by using the gradient projection method to minimize 



2m,2 

subject to ^ £ V, where m is designed as in the previous sections to guarantee 
that (l)/m,r]/m E Coo- 

Following the results of Chapter 4, we obtain 

{ Vecf) \i9'^9 < M^ 

or if 9'^ 9 = M^ and {Te(l))^9 < (8.5.73) 

(/- E?|^)re(/) otherwise 

where 61(0) is chosen so that 6l^(0)6'(0) < M^ and e = ^^^, T = T^ > 0. 

The stability properties of (8.5.73) for estimating 9* in (8.5.42) in the 
presence of the modeling error term rj are given by the following Theorem. 

Theorem 8.5.6 The gradient algorithm with projection described by the 
equation (8.5.73) and designed for the parametric model (8.5.42) guaran- 
tees that 

(i) e,ens,9,9 e Coo 

(ii) e,ens,9 G S{i:f/m?) 

(iii) If r] = then e, eUg, 9 ^ C2 

(iv) If ns,(j) £ ^00 and (j) is PE with level ao > that is independent of tj, 
then 

(a) 9 converges exponentially to the residual set 

Dp={~9\ |^~|<c(/o + f?)} 

where fj = sup^ -^j c > is a constant and fo>Oisa design 
constant. 
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(b) There exists an fj* > such that if f) < fj* , then 9 converges 
exponentially fast to the residual set 

Dp = {e\ \e\<cfi} 

for some constant c > 0. 

Proof As established in Chapter 4, the projection guarantees that |^(i)|< Mo, Vf > 
provided \0{0)\ < Mq. Let us choose the Lyapunov-like function 



2 
Along the trajectory of (8.5.73) we have 

r -e^m^ + eri if 9^0 < M§ 

V = < or if e^e = M§ and (re(/.)^6' < 

[ -e^m^ + ery - ^^e'^Tecf) if 6^6 = M^ and (re(/.)^6' > 

For d^e = M^ and (re0)^6' = e'^Te<f) > 0, we have sgn | ^^gfre'^ } = sgn{F6'}. 
For 6^9 = Afo^ we have 

Fe = 9^0 - 9*^9 > Ml - \9*\\9\ = Mo{Mo - \9*\) > 

where the last inequality is obtained using the assumption that Mq > \9*\. There- 
fore, it follows that ^^grre"^ > when 61^6' = M^ and {Te(l))^9 = O^Vecj) > 0. 
Hence, the term due to projection can only make V more negative and, therefore, 

2 9 ? 

9 9 e m^ ?7^ 

V = -e^m^ + er]< h -^ 

2 m^ 

Because V is bounded due to G C^c which is guaranteed by the projection, it 
follows that em G S{rf'/m'^) which implies that e, eris G S{ri^/ni^). From 9 G Loo 

and (/</to, 7)/m G £00, we have e, en^ G Coo- Now for 9"^ 9 = Mq we have qtyb ^ ^ 
for some constant c > which implies that 

1^1 < c|e0| < c|em| 

Hence, 9 G S{ri^ /m?) and the proof of (i) and (ii) is complete. The proof of part 
(iii) follows by setting ry = 0, and it has already been established in Chapter 4. 

The proof for parameter error convergence is completed as follows: Define the 
function 



/ ^ / %M if ^^^ = ^0 and {T€4>)'^9 > ^g 

[ otherwise 



5.74) 
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It is clear from the analysis above that f{t) > Vt > 0. Then, (8.5.73) may be 
written as 

() = Te(l)-Tfe. (8.5.75) 

We can establish that fO^ 9 has very similar properties as dsO^ 9, i.e., 
m \9\>f9'^9>f\9\{Mo-\9*\), />0 

and \f{t)\ < /o Vi > for some constant /o > 0. Therefore the proof of (iv) (a), 
(b) can be completed by following exactly the same procedure as in the proof of 
Theorem 8.5.4 (B) illustrated by equations (8.5.48) to (8.5.56). □ 

Similar results may be obtained for the SPR-Lyapunov type adaptive 
laws and least-squares by using projection to constrain the estimated pa- 
rameters to remain inside a bounded convex set, as shown in Chapter 4. 

8.5.6 Dead Zone 

Let us consider the normalized estimation error 

z-e'^<l> -e-^^ + v .„ , _„. 

e = K — = ^ (8.5.76) 

for the parametric model 

z = e*^(P + r], r] = Au{s)u + Ay{s)y + di 

The signal e is used to "drive" the adaptive law in the case of the gradient 
and least-squares algorithms. It is a measure of the parameter error 9, which 
is present in the signal 9'^ (j), and of the modeling error r/. When t] = and 
9 = we have e = and no adaptation takes place. Because — , — e £oo) 

large em implies that — - is large which in turn implies that 6 is large. 
In this case, the effect of the modeling error r/ is small and the parameter 
estimates driven by e move in a direction which reduces 9. When em is small, 
however, the effect of r] may be more dominant than that of the signal 9'^ (f) 
and the parameter estimates may be driven in a direction dictated mostly 
by r]. The principal idea behind the dead zone is to monitor the size of the 
estimation error and adapt only when the estimation error is large relative 
to the modeling error rj, as shown below: 
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/(e) = e + 5 



.20. 
m 



-^ e 



22. 
m 



(a) 



/(e) = e + 5 



.20 
m 



SO 



(b) 



Figure 8.6 Normalized dead zone functions: (a) discontinuous; (b) con- 
tinuous. 



We first consider ttie gradient algorithm for the linear parametric model 
^.5.42). We consider the same cost function as in the ideal case, i.e., 



J{0,t) 



fp'm^ 



and write 



-rVJ(6') if \tm\ > go> 
otherwise 



\v\ 



5.5.77) 



In other words we move in the direction of the steepest descent only when the 
estimation error is large relative to the modeling error, i.e., when \em\ > qq, 
and switch adaptation off when em is small, i.e., Jerri | < Qq. In view of 
(8.5.77) we have 



r</'(e + ff), g 



if |em| > qq 
— e if |em| < qq 



(8.5.78) 



To avoid any implementation problems which may arise due to the disconti- 
nuity in (8.5.78), the dead zone function is made continuous as follows: 



e = T(Pie + g), g={ 



20 



.90 
m 



if em < -go 
if em > go 
if |em,| < 5-0 



5.5.79) 



The continuous and discontinuous dead zone functions are shown in Fig- 
ure 8.6(a, b). Because the size of the dead zone depends on m, this dead 
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zone function is often referred to as the variable or relative dead zone. Sim- 
ilarly the least-squares algorithm with the dead zone becomes 

e = P(l){t + g) (8.5.80) 

where e,^ are as defined in (8.5.79) and P is given by either (8.5.71) or 
(8.5.72). 

The dead zone modification can also be incorporated in the integral adap- 
tive law (8.5.47). The principal idea behind the dead zone remains the same 
as before, i.e., shut off adaptation when the normalized estimation error is 
small relative to the modeling error. However, for the integral adaptive law, 
the shut-off process is no longer based on a pointwise-in-time comparison of 
the normalized estimation error and the a priori bound on the normalized 
modeling error. Instead, the decision to shut off adaptation is based on the 
comparison of the C25 norms of certain signals as shown below: 

We consider the same integral cost 

2 Jo rw^ir) 

as in the ideal case and write 



.^f_rVJ(0) if||e(t,.)m(.)||2/3>ffO>SUpJ|(^)t||2/3 + i/ .g^^^g^. 

I otherwise 

where /3 > is the forgetting factor, j/ > is a small design constant, 

A z{t) - e-^mir) 

and ||e(t, •)!«(•) II2/3 = [/g e~^^^~'^> e'^{t,T)m'^{T)dT]^''^ is implemented as 
it, V(-)||2/3 = {ro + 26'^ Q + e'^ROY/^ 



.5.82) 



ro = -/3ro + ^, ro(0) = 

where Q, R are defined in the integral adaptive law given by (8.5.47). 
In view of (8.5.81) we have 

e = -T{Re + Q-g) 
R = -f3R+l^^ R(0) = (8.5.83) 

Q = -(3Q-% g(o) = o 
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where 

^f if ||e(t,-)m(-)||2/3>50 

^ [ (R9 + Q) otherwise 

To avoid any implementation problems which may arise due to the discon- 
tinuity in g, the dead zone function is made continuous as follows: 



9 



' if ||e(t,-)m(-)||2/3>2ffo 

(i?0 + Q)(2-M!::M:^) if5o<||e(t,-M-)ll2/3<25o (8.5.84) 
. {RQ^Q) if ||e(t,-M-)ll2/3<50 



The following theorem summarizes the stability properties of the adaptive 
laws developed above. 

Theorem 8.5.7 The adaptive laws (8.5.79) and (8.5.80) with P given by 
(8.5.71) or (8.5.72) and the integral adaptive law (8.5.83) with g given by 
(8.5.84) guarantee the following properties: 

(i) e,ens,9,9 e Coo- 

(ii) e,ens,e e S {go + ri"^ / m'^) . 

(iii) ^e£2n^i- 

(iv) limf^oo Git) = 9 where is a constant vector. 

(v) If ns,(j) e £oo o,nd cf) is PE with level oq > independent of i], then 9{t) 
converges exponentially to the residual set 



Dd={9^n''\\~9\<c{go + n)] 



where 7] = sup^ ^Wr and c> is a constant. 
Proof Adaptive Law (8.5.79) We consider the function 

V0) - ^ 

whose time derivative V along the solution of (8.5.79) where em? = —O^cf) + ry is 
given by 

V = F(j>{e + g) = -(em^ - 7y)(e + g) (8.5.85) 

Now 

(em + gaf - (go + ^)(e»™ + 5o) > if em < -go 
{em''-r]){e+g)= { {em - gof + {go - ^){em - ga) > ii em > go (8.5.86) 
if \em\ < go 
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Hence, {em'^ — 'q){e + 5) > 0,Vt > and F < 0, which implies that V,6 a Loo and 
^ (em?- — rj){€ + g) (£ £2- Furthermore, 6 G £00 imphes that 0,e,ens G Coo- From 
(8.5.79) we have 



e'e 



0'rr0 



m^ 



However, 



{e + gfm^ 



.5.87) 



(e + g)'^'w? = {em + gm)^ 



(em + g^Y 


if em < -50 


(em - gaf 


if em > go 





if |em| < 5o 



which, together with (8.5.86), imphes that 

< (e + g)^m^ < (em^ — ?7)(e + g)^ i.e., (e + g)m G £2 

Hence, from (8.5.87) and — G C^o we have that G £2- Equation (8.5.85) can also 
be written as 



by using I5I < 



3o 



V < —e m + \em\ h |e?7i|go + —9o 

m m 

Then by completing the squares we have 

|2 



V < 



< 



2 2 

e m^ 



\m_ 

TV? 

2m? 



9l 



m 



m 



-90 



t5o 



which, together with V G £00, implies that em G S{gQ + -^). Because m,"^ = 1 + n^ 
we have e, en,, G S{g^ + ^). Because I5I < — < ci^o, we can show that \6\ < 

( I em I + 5o ) I which implies that 9 G 5 (^q + ^ ) due to em G 5 (^q + ^ ) • Because go 

is a constant, we can absorb it in one of the constants in the definition of m.s.s. and 

2 
write em,, 9 G S{go + -^) to preserve compatibility with the other modifications. 

To show that limt_+oo 9 = 9,we use (8.5.85) and the fact that {em'^ — 'rj){e+g) > 

to obtain 



V 



< 



< 



-(em^- 'n){e + g) 



IL 
m 



■g\m 



em 



90 



m 



g\m 



m 



\e + g\m, (because |e + gr| = if |e?7i| < go) 



\v\ 



Because — G Coo and go > we integrate both sides of the above inequality and 
use the fact that V G £00 to obtain that (e + g)m, G Ci. Then from the adaptive 
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law (8.5.79) and the fact that — G Coo, it follows that \9\ G Ci, which, in turn, 
implies that the linij^oo /n (^dr exists and, therefore, 6 converges to 6. 

To show that 6 converges exponentially to the residual set D^ for persistently 
exciting 0, we follow the same steps as in the case of the fixed cr-modification or 
the El-modification. We express (8.5.79) in terms of the parameter error 



-e + T 



(t>V 



rn 



(8.5.88) 



where g satisfies \g\ < — < cigo for some constant ci > 0. Since the homogeneous 
part of (8.5.88) is e.s. when (f) is PE, a property that is established in Section 4.8.3, 
the exponential convergence of 9 to the residual set Dd can be established by re- 
peating the same steps as in the proof of Theorem 8.5.4 (iii). 



Adaptive Law (8.5.80) The proof for the adaptive law 
similar to that of (8.5.79) presented above and is omitted. 



.5.80) is very 



Adaptive Law (8.5.83) with g Given by (8.5.84) This adaptive law may 
be rewritten as 

e = (7^T I e~'^^*~^'>e{t,T)(l>{T)dT (8.5.89) 

where 



1 if ||e(i,-)m(-)||2;3>2ao 

Mi^:M^_l ■dg,<\\e{t,-)m{-)h,<2go 
if ||e(i,-)^(-)ll2;3<5o 



Once again we consider the positive definite function V{6) 
derivative along the solution of (8.5.83) is given by 



(8.5.90) 



whose time 



Using e'^{t)(}>{T) 



V 



V = aJ^{t) e-'3(*-^)e(i,T),^(r)dr 



v{t) 



-e{t,T)m'^{T) + r]{T), we obtain 



e-^(*-^)e(i,r)m(T) 



e{t,T)m{T) 



m{T) 



dT 



(8.5.91) 



Therefore, by using the Schwartz inequality, we have 



V < -aMt, ■)m{-)\\2p \\e{t, ■)m{-)hp - \\{^)t\\2p 



From the definition of a^ and the fact that g^ > sup^ \\{ — 



1 2/3 



it follows 



that y < which implies that V,9,e (£ Coo and linit^oo = Kx) exists. Also 6 G Coo 
implies that eUg G Coo- Using go > supj ||(^)t||2fl + ^^ in (8.5.91), we obtain 



V < -We||e(t,-)TO(-)||2/3 



612 
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Now integrating on both sides of the above inequality and using V G Coo , we have 

(7e||e(t,-M-)ll2/3ei:i (8.5.92) 

Using (8.5.89) and the boundedness property of ^, we can estabhsh that \6\ G Ci. 
Moreover, from (8.5.83) with g given by (8.5.84) we also have that is uniformly 
continuous which together with 6 £ Ci imply that limj^oo ^(0 = 0. Furthermore, 
using the same arguments as in the proof for the adaptive law (8.5.79), we can 
conclude from \6\ G Ci that limt_,oo = 6 for some constant vector 6. 

2 

It remains to show that e^eUg G 5(go + "^). This can be done as follows: 
Instead of (8.5.91), we use the following expression for V: 



V 



it) 



-^^^^*-''^e{t,T)4>{T)dT 



g 



-9^Re + 9^{t) 



\-Pit-r,m!li^dr + 9 



inn?{T) 



9 



obtained by using (8.5.83) instead of (8.5.89), which has the same form as equation 
(8.5.58) in the proof of Theorem 8.5.4. Hence, by following the same calculations 
that led to (8.5.59), we obtain 



V < 



Fm 1 



2 2 

Using the definition of e{t, t), we obtain 



(-) 



my t 



2/3 



(8.5.93) 



\RO+Q\ 



-Pi 



,_^^ <^{T){e'^{TmT)-z{T)) 



dT 



e-f^('-^^(l>{T)e{t,T)dT 






lk(<,-)m(-)*||2/3 



where the last inequality is obtained by using the Schwartz inequality. Because 
^ G £00, we have 

\R0+Q\<C2Mt,-)m{-)thp (8.5.94) 

for some constant C2 > 0. Using the definition of g given in (8.5.84) and (8.5.94), 
we have 

IffI < cga 
for some constant c > and therefore it follows from (8.5.93) that 



V < 



Fm 1 



1 

TO/ t 



2/3 



ego 
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where c > depends on the bound for \6\. 

The above inequaUty has the same form as (8.5.59) and we can duplicate the 
steps illustrated by equations (8.5.59) to (8.5.63) in the proof of Theorem 8.5.4 (A) 
to first show that R'sd G ^(^o + if' /rn^) and then that e, tng, 9 G S{gQ + if' /ni^). 

The proof for part (v) proceeds as follows: We write 

e = -vm + T f e-^(*-^) ^dr + r^ (8.5.95) 



Because the equilibrium 6e = of the homogeneous part of (8.5.95), i.e., 9 = —TR9, 
is e.s. for persistently exciting (j), a property that has been established in Section 
4.8.4, we can show as in the proof of Theorem 8.5.4 A(iii) that 

\9\ < Poe-"'' + (3i f e-^-'^'-^^\d{T)\dT 
Jo 

where d = L e"'^'-*"'^' ^dr + g, /3o,/3i are nonnegative constants and P2 > 0. 
Because — G Coo and — < 77, we have \d\ < cif] + \g\. Because \g\ < ego, we have 

1^1 <c{f] + go) + et 

for some constant c > 0, where et is an exponentially decaying to zero term which 
completes the proof of part (v). D 

8.5.7 Bilinear Parametric Model 

In this section, we consider the bilinear parametric model 



T] = Au(s)u + Ay{s)y + di 



5.5.96) 



where z,ip,zo are measurable signals, W{s) is proper and stable, p*,9* 
are the unknown parameters to be estimated on-line and r] is the model- 
ing error term due to a bounded disturbance di and unmodeled dynamics 
Au(s)u,Ay(s)y. The perturbations Au(s),Ay(s) are assumed without loss 
of generality to be strictly proper and analytic in Re[s] > —5o/2 for some 
known 5o > 0. 

The techniques of the previous sections and the procedure of Chapter 4 
may be used to develop robust adaptive laws for (8.5.96) in a straightforward 
manner. 
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As an example, we illustrate the extension of the gradient algorithm to 
the model (8.5.96). We express (8.5.96) as 

where (f) = W(s)^p, zi = W(s)zq. Then the gradient algorithm (based on the 
instantaneous cost) is given by 



re0sgn(p*) - 


-wxVQ 


76^ — W2"yp 




z — z z — 


Pi0'^<p + zi) 


m^ 


m? 


0^</) + Zl 





5.5.97) 
'in~ 'in~ 

where 9,p is the estimate of 6* , p* at time t; m > is chosen so that 
m^m^m ^ ^^^ wi,W2 are leakage modifications and F = F^ > 0,7 > 
are the adaptive gains. Using Lemma 3.3.2, the normalizing signal m may 

be chosen as 

m? = 1 + (f^ (j) + zl + n1, n1 = nis 
riis = -Soms + u^ + y^, ms{0) = 

If A„, Ay are biproper, then m^ may be modified to include u, y, i.e., 

m^ = 1 + (f^(p + zf + nl + u^ + y'^ 

li (j) = H{s)[u,y]'^ , zi = h{s)[u,y]'^ , where H{s),h{s) are strictly proper and 
analytic in Re[s] > —So/2, then the terms (j)^ (f>, zf may be dropped from the 
expression of m^. 

The leakage terms wi, W2 may be chosen as in Section 8.5.2 to 8.5.4. For 
example, if we use the switching a-modification we have 

wi = ais, W2 = (T2s (8.5.98) 

where 



CTl 



if \xi\ < Mi 

CTo(^-l) if Mi < \xi\ < 2Mi 



(Jo if \xi\ > 2Mi 

with i = 1,2 and |xi| = \9\, \x2\ = \p\, and ctq > is a design constant. The 
properties of (8.5.97) and (8.5.98) can be established in a similar manner as 
in Section 8.5.3 and are summarized below. 
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Theorem 8.5.8 The gradient algorithm (8.5.97) and (8.5.98) for the bilin- 
ear parametric model (8.5.96) guarantees the following properties. 

(i) e,ens,p,9,p,0 e Coo 
(ii) e,ens,p,9 G Siri^/rn^) 

The proof of Theorem 8.5.8 is very similar to those for the hnear parametric 
model, and can be completed by exploring the properties of the Lyapunov 
function V = |p*|^ + |^. 

As we discussed in Chapter 4, another way of handling the bilinear case 
is to express (8.5.96) in the linear form as follows 

z = W{s){e*'^^) + rj (8.5.99) 

where 9* = [61,9^'^]'^ ,91 = p*,9* = p*9* and tjj = [zq, i/j'^]^ . Then using the 
procedure of Sections 8.5.2 to 8.5.4, we can develop a wide class of robust 
adaptive laws for estimating 9* . From the estimate 9 of 9* , we calculate the 
estimate 9, p of 0* and p* respectively as follows: 

P = 9i, 0=^ (8.5.100) 

where 9i is the estimate of 9l = p* and 02 is the estimate of ^2 = p*9*. 
In order to avoid the possibility of division by zero in (8.5.100), we use the 
gradient projection method to constrain the estimate 9i to be in the set 

C = ^9e 7^"+^ \g{9) = po- 9isgnp* < } (8.5.101) 

where po > is a lower bound for |p*|. We illustrate this method for the 
gradient algorithm developed for the parametric model z = 9 <j) + 7], (j) = 

W{s)'il) = [zijCf)^]^ given by 



Tecf) - wT9 

z — z z - 



vn? vn? 



5.5.102) 



where m > is designed so that — , — £ £00 • We now apply the gradient 
projection method in order to constrain 9{t) ^ C \/t > to, i.e., instead of 
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(8.5.102) we use 

(r{e4>-we) aeeCo 

or if 6* e (5(C) and [T{t(j) - we)]'^\/g < 
/-r ^^7/J )r{e4>-we) otherwise. 



(8.5.103) 
where Co,5(C) denote the interior and boundary of C respectively. 

Because V <? = [— sgn (p* ),0,...,0]^, (8.5.103) can be simplified by choos- 
ing T = diag{'yQ,T()) where 70 > and Fq = Tg" > 0, i.e., 



0i={ 



7oezi - 701^^1 if ^isgn(p*) > po 

or if ^isgn(p*) = po and (ezi — w6i)sgn(p*) > 
otherwise 



62 = To{e4> - wh) 

(8.5.104) 
The adaptive law (8.5.104) guarantees the same properties as the adap- 
tive law (8.5.97), (8.5.98) described by Theorem 8.5.8. 

8.5.8 Hybrid Adaptive Laws 

The adaptive laws developed in Sections 8.5.2 to 8.5.7 update the estimate 
9{t) of the unknown parameter vector 9* continuously with time, i.e., at each 
time t we have a new estimate. For computational and robustness reasons, 
it may be desirable to update the estimates only at specific instants of time 
tk where {t^} is an unbounded monotonically increasing sequence in TZ'^ . 
Let tk = kTg where T^ = tk+i — tk is the "sampling" period and k £ A^"*" 
and consider the design of an adaptive law that generates the estimate of 
the unknown 6* at the discrete instances of time t = 0, T^, 2Ts, .... 

We can develop such an adaptive law for the gradient algorithms of Sec- 
tion 8.5.3. For example, let us consider the adaptive law 



Fe0 - wVe 

z — z z - 



m? m? 



5.5.105) 



where z is the output of the linear parametric model 
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± ri_ 
m 

to ifc+i = (k + l)Ts we have 



and m is designed so that — , — £ £oo- Integrating (8.5.105) from tk = kTg 



Ok+i = 6k + T r^' {<T)ct)(T) - w(T)ek)dT (8.5.106) 

•Itk 

where 9k = 0{tk)- Equation (8.5.106) generates a sequence of estimates, i.e., 
00 = 0(0), 01 = 0(r,),02 = e{2Ts),...,ek = e{kT,) of 0*. Although e, </> 
may vary with time continuously, 9{t) = Ok = constant for t £ [tk,tk-\-i). In 
(8.5.106) the estimate z of z and e are generated by using 9k, i.e., 

z{t) = eJcPit), e = ^--^, t e [ifc,tfc+i) (8.5.107) 

We shall refer to (8.5.106) and (8.5.107) as the robust hybrid adaptive law. 

The leakage term w(t) chosen as in Section 8.5.3 has to satisfy some 
additional conditions for the hybrid adaptive law to guarantee similar prop- 
erties as its continuous counterpart. These conditions arise from analysis 
and depend on the specific choice for w{t). We present these conditions and 
properties of (8.5.106) for the switching a-modification 

^('^ = ""- "^ = I ao if \9k\ > Mo (^-^-^^^^ 

where itq > and Mq > 2|0*|. Because of the discrete-time nature of 
(8.5.106), (7s can now be discontinuous as given by (8.5.108). 

The following theorem establishes the stability properties of (8.5.106), 
(8.5.108): 

Theorem 8.5.9 Let m,aQ,Ts,T be chosen so that 

(a) ie£oo,^<l 

(b) 2TsXm < l,2aoXmTs < I 

where Am = Xmaxi^)- Then the hybrid adaptive law (8.5.106), (8.5.108) 
guarantees that 

(i) e, en<j G £oo, Ok e ioo 
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(ii) e,em G S{^),A0k E V{^) where M^ = 9k+i - 0k and 

A i '^°^^ ftkQ+NTs 

T^{y) = \ {Xk} J2 ^l^k < Co y{T)dT + Ci 

[ k=ko •^*'=o 



for some cq, ci e TZ'^ and any ko, N E A/""*". 

(iii) If ns,4> £ -Coo and (p is PE with a level of excitation oq > that is 
independent ofrj, then 

(a) Ok = 9k — 0* converges exponentially to the residual set 

where c > 0, f/ = sup^ | ^ | . 

(b) There exists a constant f)* > such that if f) < fj* , then Ok 
converges exponentially fast to the residual set 

Ve = {o\\0\ <cf]] 

Proof Consider the function 

V{k) = ejT-^dk (8.5.109) 



Using ^fe+i = ek + A9k in (8.5.109), where A6'fe = r/j*'=+'(e(T)0(T) - w(T)6'fe)rfr, we 



can write 



V{k+1) = V{k) + 2elVMk + MlVMk 

= V{k) + 2^7 / '^' (e(T)<^(T) - w{T)ek)dT 



.5.110) 



+ / {e{T)<j>{T)-w{T)ek)'dTT {e{T)(^{T)-w{T)ek)dT 



Because 6~l(j) = —era^ + 77, we have 



fc+i 



■A; + l 



^J I e{T)(l>{T)dT = I {-e^m^ + er])dT < 



tk+i Ji^i 



rfT+ / -rr-^dr 



2m^ 
;8.5.111) 
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where the last inequality is obtained by using the inequality —a^ + ab< —\-\- \ 
Now consider the last term in (8.5.110), since 



(e(r)0(T) - w{T)ekydTT / (e(T)0(T) - w{T)ek)dT 



< K 



{e{T)d^{T) - w{T)ek)dT 



where Am = \max{J^ ^), it follows from the inequality [a + 6)^ < 2a^ + 26^ that 



{t{T)^{T) - w{T)ek)^dTT / (e(T)0(T) - w{T)ek)dT 



< 2X 

< 2X 

< 2\mTs 



2K 



tk^ 



tk + 1 

tk ^iV 

tk + i ftk + i |J,|2 

e\T)m\T)dT / '^' 

tfc Jt 

tk + l 

2 /^\,^„ 2 /^\ 7^ I r) \ ^2t-i2|/] |2 



w{T)6kdT 






e^(r)m^(T)rfT+2A„a,^T,r^|efe|^ 



.5.112) 



In obtaining (8.5.112), we have used the Schwartz inequality and the assumption 
J|t < 1. Using (8.5.111), (8.5.112) in (8.5.110), we have 

l-tk + i ftk + i |„|2 

V{k+1) < V{k)-{l-2\mTs) e\T)m\T)dT+ ^-Aydr 



-2asTs6p. 6k + 2\mCrgT^ \9k 



2rp2 I /i. 1 2 

- s 

ik + 1 



< V{k)-{l-2\mTs) e'{T)m'{T)dT + f]'Ts 

•Itk 

—2asTs{6f. 6k — XmaoTs\9k\ ) 

< V{k) - (1 - 2A„T,) f "^^ e''{T)m\T)dT + fT^ 

-Itk 



.5.113) 



where the last inequality is obtained by using 91 6 k > -^ ■2"' Therefore, for 

l-2an\^Ts > and 1-2A„T5 > 0, it follows from (8.5.113) that V{k+l) < V{k) 
whenever 

Thus, we can conclude that V{k) and 6k G ioo- The boundedness of e, em follows 
immediately from the definition of e and the normalizing properties of m, i.e., 
± JL p r 
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To establish (ii), we use the inequahty 

> yl^fcl'+yl^/c|(|^.|-2|r|) 

Because fis = for |6'fe| < Mq and cr^ > for \ek\ > Mq > 2\e*\, we have (Ts\0k\{\0k\- 
2\e*\) > Vfc > 0, therefore, 

which together with 2aQXmTs < 1 imply that 

(7,(^7 0fc - \„,aoTs\ek\^) > c,as\ek\^ (8.5.114) 

where c„ = ^ — X^ai^Tg. From (8.5.114) and the second inequality of (8.5.113), we 
have 

(1-2A„T,) r^\\T)m'{T)dT+c,a,\0k\'' <V{k)-V{k+l)+ f "^^dr 

(8.5.115) 

2 2 

which implies that em £ S{^) and ^faldk G X'(-^). Because |e| < \(.m\ (because 

2 

m > 1 , Vt > ) , we have e G 5 ( -^ ) . 

Note from (8.5.112) that Mk satisfies 

ka+N ko+N t^+i ko+N 

|2 



J2i^SkV^0k < 2XmT,Y^ j''^\^{T)m^{T)dT + 2\„,T^ Y. ''''s\^'^\ 

" '" k^ko ^ k—kQ 

l-tka + N ko+N 

< 2X,nTs / e\T)m\T)dT+2X^T^ ^ a^JOkl^ (8.5.116) 



feo+A' 

"' e^{T)m'^{T)dT+2X.mT^ 

^''0 k=ko 

2 2 

Using the properties that em G S{^),(Tg6k G X'(^), we have 



V (A(?fe)^Aefc < ci + C2 / ^dr 



for some constant Ci,C2 > 0. Thus, we conclude that A9k G I?(-^). 

Following the same arguments we used in Sections 8.5.2 to 8.5.6 to prove pa- 
rameter convergence, we can establish (iii) as follows: We have 



m'^ir) Jt. m^lyT) 
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which we express in the form 

ek+i = A{k)ek + Bi^{k) (8.5.117) 

where A{k) = I - T J^^^^ '-^^^dr, B = T, .{k) = /^-^ ^^dr - a,e,T,. 
We can establish parameter error convergence using the e.s. property of the homo- 
geneous part of (8.5.117) when (j) is PE. In Chapter 4, we have shown that (f) being 
PE implies that the equilibrium 0^ = of 0fe+i = A{k)9]^ is e.s., i.e., the solution 6}. 
of (8.5.117) satisfies 

k 

|^fe|</3o7' + /3i5]7'">i| (8.5.118) 



for some < 7 < 1 and /Jq,/?! > 0. Since \vi\ < c[ri + <tq) for some constant c > 0, 
the proof of (iii) (a) follows from (8.5.118). From the definition of Vk, we have 



\vk\ < cori + ci\asOk\ < cotj + c-^\(Js9k\ \0k\ 



.5.119) 



for some constants co,ci,C]^, where the second inequality is obtained by using 
^.l^fcl < ^sil^ < M^;^\WsOk\ \0k\- Using (8.5.119) in (8.5.118), we have 



fe-i 



1^1 < Pol" + P'lf] + P2YI t'^^'I ^sOM 



.5.120) 



where /3; = f^,/32 = /3ic;. 

To proceed with the parameter convergence analysis, we need the following 
discrete version of the B-G Lemma. 

Lemma 8.5.1 Let x(k), f(k),g(k) be real valued sequences defined for k = 
0, 1, 2, . . . ,, and f{k), g{k), x{k) > \/k. If x{k) satisfies 

fc-i 
x{k)<f{k) + Y,g{i)x{i), A: = 0,1,2,... 

4 = 

then, 



fc-i 
ik) < f{k) + ^ 

i=0 



fc— 1 

n (i+^a)) 



g{i)f{i), k = 0,1,2, 



where n,=j+i(l + 9{j)) is set equal to 1 when i = k — 1. 
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The proof of Lemma 8.5.1 can be found in [42]. 

Let us continue the proof of Theorem 8.5.7 by using Lemma 8.5.1 to obtain 
from (8.5.120) that 

fc-i c fc-1 "I 

|^'fc|</3o7' + /3;^+E^M n {i + (i2<Js\ej\)\p2\'Jse,\{f3o + l3[rjl-l (8.5.121) 

i=0 [j=i+l J 

Using the inequahty Ili^i ^i ^ (X^i=i Xi/n)^ which holds for any integer n and 
positive Xi, we have 



fc-i-l / I A;-i-l 






Because cr^l^fcl < ^M^-ii^p i* follows from (8.5.115) that 



.5.122) 



^sM < c \v{k) -V{k+l)+ I "^^ ^dT 

for some constant c, which implies that 
fc-i 

Y, l^2<ys\0j\ <Cif (fc-i-l)+Co 

for some constant Ci,Co > 0. Therefore, it follows from (8.5.122) that 

< fl + cif + ^_'^°_ J (8.5.123) 

Because for a; > 0, the inequality (1 + -)" < e^ holds for any integer n > 0, it 
follows from (8.5.123) that 

fe-i 

n {^ + P2'js\0j\)<{l + ciff'''\^^ (8.5.124) 

Using (8.5.124) in (8.5.121), we have 

fc-i 
l^fel < /3o7' + /3l^ + Et''(1 + cif )''-'-' e^^ (32asm{po + (3[m~') (8.5.125) 

i=0 
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Because /320's|^i| G 'Coo and 7 < 1, the inequality (8.5.125) leads to 

fe-i fe-i 

\0k\ < Pol" + M + /33(V7)' E { V7(l + ci^')}'"'"' + /34^ E[7(l + cif )]* 



ifc— i 



i=0 1=0 

for some constants /33,/34 > 0. If ?7 is chosen to satisfy ^/7(1 + ciff) < 1, i.e., for 
fj*2 _ — ^p_ y Q ^^^ ^2 ^ ^*2^ ^g obtain 

\0k\ < Pol" + I3iv + I3',{^)'' + I3'^T^ 

for some constants P^, P4 > 0. Therefore, 0^ converges exponentially to a residual 
set whose size is proportional to fj. □ 



8.5.9 Effect of Initial Conditions 

The effect of initial conditions of plants such as the one described by the 
transfer function form in (8.5.1) is the presence of an additive exponentially 
decaying to zero term rjo in the plant parametric model as indicated by 
equation (8.5.8). The term r]o is given by 

r]o = Cjuj 

where Ac is a stable matrix and loq contains the initial conditions of the 
overall plant. As in the ideal case presented in Section 4.3.7, the term rjo 
can be taken into account by modifying the Lyapunov-like functions V{9) 
used in the previous sections to 

Vmie) = Vie) + uj'^Pou; 

where Pq = Pq > satisfies the Lyapunov equation PqAc + AJPq = ~7o-^ 
for some 70 > to be chosen. As in Section 4.3.7, it can be shown that the 
properties of the robust adaptive laws presented in the previous sections are 
not affected by the initial conditions. 

8.6 Summary of Robust Adaptive Laws 

A robust adaptive law is constructed in a straight forward manner by mod- 
ifying the adaptive laws listed in Tables 4.1 to 4.5 with the two crucial 
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modifications studied in the previous sections. These are: the normalizing 
signal which is now chosen to bound the modeling error term rj from above 
in addition to bounding the signal vector cp, and the leakage or dead zone or 
projection that changes the "pure" integral action of the adaptive law. 

We have illustrated the procedure for modifying the adaptive laws of 
Tables 4.1 to 4.5 for the parametric model 

z = Wis)[e*^tP + W-\s)ri], r] = Auis)u + Ayis)y + di (8.6.1) 

which we can also rewrite as 

z = e*^(j) + r] (8.6.2) 

where (p = W(s)tp. Without loss of generality, let us assume the following: 

51. W(s) is a known proper transfer function and W(s), W~^(s) are ana- 
lytic in Re[s] > —5o/2 for some known Sq > 0. 

52. The perturbations Au(s),Ay(s) are strictly proper and analytic in 
Re[s] > —Sq/2 and Jq > is known. 

53. tp = HQ{s)[u,y]'^ where Hq{s) is proper and analytic in Re[s] > —5o/2. 

For the LTI plant models considered in this book, assumptions SI and S3 
are satisfied by choosing the various design polynomials appropriately. The 
strict properness of A„, A^^ in assumption S2 follows from that of the overall 
plant transfer function. 

Let us first discuss the choice of the normalizing signal for parametric 
model (8.6.1) to be used with the SPR-Lyapunov design approach. We 
rewrite (8.6.1) as 

Zf = W{s)L{s) [e*^,Pf + 7]f] (8.6.3) 

with 

Zf = —z, (pf = —L [s)ip 

^ s + ho ^ s + ho 

rjf = L-\s)W-\s)^^{A^{s)u + Ay{s)y + di) 

S + tlQ 

by filtering each side of (8.6.1) with the filter ^ "^ . We note that L{s) is 
chosen so that WL is strictly proper and SPR. In addition, L~^(s),L(s) are 



8.7. PROBLEMS 625 

analytic in Re[s] > —So/2 and /iq > So/2. Using Lemma 3.3.2, we have from 
assumptions SI to S3 that the normahzing signal m generated by 



m' -- 


9 9 

= 1 + rig, Ug = m, 


rhs - 


= -Sorrig + u^ + y^, 



mg{0) = (8.6.4) 

bounds both (pf^rjf from above. The same normalizing signal bounds ?], ip in 
the parametric model (8.6.2). 

In Tables 8.1 to 8.4, we summarize several robust adaptive laws based 
on parametric models (8.6.1) and (8.6.2), which are developed by modifying 
the adaptive laws of Chapter 4. Additional robust adaptive laws based on 
least-squares and the integral adaptive law can be developed by following 
exactly the same procedure. 

For the bilinear parametric model 

z = p*[6*'^(j) + zi) + ri, r] = Au{s)u + Ay{s)y + d (8.6.5) 

the procedure is the same. Tables 8.5 to 8.7 present the robust adaptive laws 
with leakage, projection and dead zone for the parametric model (8.6.5) when 
the sign of p* is known. 



8.7 Problems 

8.1 Consider the following system 

200 

y = 



(s-p)(s+ 100) 

where < t <C 1 and p « 1. Choose the dominant part of the plant and 
express the unmodeled part as a (i) multiplicative; (ii) additive; and (iii) 
stable factor perturbation. 

Design an output feedback that regulates y to zero when r = 0.02. 

8.2 Express the system in Problem 8.1 in terms of the general singular perturbation 

model presented in Section 8.2.2. 

8.3 Establish the stability properties of the switching-cr modification for the exam- 

ple given in Section 8.4.1 when < Mq < \0*\. 
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Table 8.1 Robust adaptive law based on the SPR-Lyapunov 

method 



Parametric 
model 


z = W{s)e*^(j) + r],r] = Auis)u + Ay(s)y + d 
<P = Ho{s)[u,y]'^ 


Filtered 

parametric 

model 




Adaptive law 


= Te(l)- TwO 

e = z-z- W{s)L{s)en^^ 


Normalizing 
signal 


m'^ = 1 + nj., n'j = nis 

ms = -Squis + v? + y'^, ms(0) = 


Leakage 

(a) Fixed a 

(b) Switching a 

(c) e-modification 


W = (J 

W = (Js = ' 

w = em z^o 


■ if \e\ < Mo 

(g^-l)ao ifMo<|^|<2Mo 
. (TO if \0\ > 2Mo 


Assumptions 


(i) Au,Ay strictly proper and analytic in Re[s] > 
—5q/2 for some known 5q > 0; (ii) W(s),Hq(s) are 
known and proper and W{s), W~^{s), Hq{s) are an- 
alytic in Re[s] > -8q/2 


Design 
variables 


r = r' > 0;cro > 0;z>o > 0; /lo > 5o/2; L'^s) 
is proper and L{s),L~^{s) are analytic in Re[s] > 
-(5o/2; W{s)L{s) is proper and SPR 


Properties 


(i) e,em,9,9 e £oo; (ii) e,em,9 G 5(/o + rj'^/m'^), 
where fo = a ioi w = a, fo = for w = ag, and 
/o = 1^0 for w = em z/Q 
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Table 8.2 Robust adaptive law with leakage based on the 

gradient method 



Parametric model 


z = e*^(l) + 7], T] = Auis)u + Ay{s)y + d 


Adaptive law 


z-e'^c^ 


m2 


Normalizing 
signal 


As in Table 8.1 


Leakage w 


As in Table 8.1 


Assumptions 


(i) Au,Ay strictly proper and analytic in 
Re[s] > —5o/2 for some known ^o > 0; (ii) (j) = 
H{s)[u,y]'^ , where H(s) is strictly proper and an- 
alytic in Re[s] > -5o/2. 


Design 
variables 


r = r^ > 0; The constants in w are as in Table 
8.1. 


Properties 


(i) e, em, 9,0 e Coo; (ii) e, em, 6 e S{irf/m'^ + /o), 
where /o is as defined in Table 8.1. 



8.4 Consider the following singular perturbation model 

X = Aiix + A12Z + biu 

^z = A22Z + 62U 

where x G TZ"',z G TZ^^tV G TZ^ and A22 is a stable matrix. The scalar 
parameter /i is a small positive constant, i.e., < /i ^ 1. 

(a) Obtain an nth-order approximation of the above system. 

(b) Use the transformation 77 = Z + A22 b2U to transform the system into one 

with states x, rj. 

(c) Show that if u = —Kx stabilizes the reduced-order system, then there 

exists a /i* > such that u = —Kx also stabilizes the full-order system 
for any y, e [0,/i*). 
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Table 8.3 Robust adaptive law with projection based on the 

gradient method 



Parametric 
model 


z = 9*^(f) + r], r] = Auis)u + Ay{s)y + d 


Adaptive law 


0=< 


Tec/. if \e\ < Mo 

or if \e\ = Mo and (Tecpye < 
(/ - Pl^) Te(t> otherwise 




m? 


Normalizing 
signal 


As in Table 8.1 


Assumptions 


As in Table 8.1 


Design 

variables 


1^(0)1 <Mo; Mo> \9*\; P = P^ > 


Properties 


(i) e, em, 6,9 ^ Coo] (ii) e, tm, 6 e S{ri'^/m'^) 



8.5 Establish the stabiUty properties of the shifted leakage modification —'w{9 — 9*) 

for the three choices of w and example given in Section 8.4.1. 

8.6 Repeat the results of Section 8.4.1 when u is piecewise continuous but not 

necessarily bounded. 

8.7 Repeat the results of Section 8.4.2 when u is piecewise continuous but not 

necessarily bounded. 

8.8 Repeat the results of Section 8.4.3 when u is piecewise continuous but not 

necessarily bounded. 

8.9 Simulate the adaptive control scheme given by equation (8.3.16) in Section 8.3.3 

for the plant given by (8.3.13) when 6=2. Demonstrate the effect of large 
7 and large constant reference input r as well as the effect of switching-off 
adaptation by setting 7 = when instability is detected. 
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Table 8.4 Robust adaptive law with dead zone based on the 

gradient Method 



Parametric model 


z = 6*'^4> + r], r] = Au{s)u + Ay{s)y + d 


Adaptive law 


( ^ if em < -50 
9 = \ - m if e"i > 50 
1 — e if em < 50 


m^ 


Normalizing signal 


As in Table 8.1 


Assumptions 


As in Table 8.1 


Design variables 


5o>g;r = rT>o 


Properties 


(i) e, em, 0,9 ^ Coo; (ii) e, ew-, G S{rf/w? + go); 

(iii) limt^oo o{t) = e 



8.10 Consider the closed-loop adaptive control scheme of Section 8.3.2, i.e., 

X = ax -\- z — u 
^z = —z + 2u 
y = x 
u = —kx, k = ^x^ 

Show that there exists a region of attraction T) whose size is of O(^) for 
some a > such that for a;(0), 2;(0), fc(0) G D we have x(t),z(t) —> and 
k{t) > k{oo) as i — > cxD. (Hint: use the transformation rj = z — 2u and 

choose V = ^ + ^ "„ ' + fj, ^^^''^ where k* > a.) 
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Table 8.5 Robust adaptive law with leakage for the bilinear 

model 



Parametric 
model 


z = p*(0*^(j) + zi)+7], r] = A„(s)u + Ay(s)y + d 


Adaptive law 


e = Te(t>sgn{p*) - wiTO 


Normalizing 
signal 


As in Table 8.1. 


Leakage Wi 
i = 1,2 


As in Table 8.1 


Assumptions 


(i) A„,Ay are as in Table 8.1; (ii) cf) = H{s)[u,y]^ , 
z\ = /ii(s)u + h2{s)y, where H(s),hi(s),h2{s) are 
strictly proper and analytic in Re[s] > —5q/2 


Design 
variables 


V = r^ > 0, 7 > 0; the constants in Wi are as defined 
in Table 8.1 


Proporties 


(i) e,em,p,9,p,6 e Coo', (ii) e,em,p,6 £ S{rf/m? + 
/o), where /o is as defined in Table 8.1 



8.11 Perform simulations to compare the properties of the various choices of leakage 
given in Section 8.4.1 using an example of your choice. 



8.12 Consider the system 



y = 6*u + ?7 
y = A(s)u 



where y,u are available for measurement, 9* is the unknown constant to 
be estimated and 7y is a modeling error signal with A(s) being proper and 
analytic in Re[s] > —0.5. The input u is piece wise continuous. Design an 
adaptive law with a switching-cr to estimate 6* . 
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Table 8.6 Robust adaptive law with projection for the bilinear 

model 



Parametric 
model 


Same as in Table 8.5 


Adaptive 
law 


0^=< 
Ol = 

e = 


'V,t(^i if \e.i\ < Mi 

or if \ei\ = M, and {Titcpiyei < 

/ y Q_nT \ 

( ^ ~ wi~k } ^'^^^ otherwise 
1,2 with 

e,e2=p,<pi= (psgn{p*), (/,2 = e, Ti = r, Ps = 7 


Assumptions 


As in Table 8.5 


Normalizing 
signal 


As in Table 8.1 


Design 
variables 


1^(0)1 <Mi,|p(0)| <M2;r = rT >0,7>0 


Properties 


(i) e, em, p, 9,p,0 e Coo', (ii) e, em, p,6 e S{tf /m?) 



8.13. The linearized dynamics of a throttle angle 6 to vehicle speed V subsystem 
are given by the 3rd order system 

bpiP2 



V 



-e + d 



{s + a){s + pi){s + P2) 
where pi,P2 > 20, 1 > a > and rf is a load disturbance. 

(a) Obtain a parametric model for the parameters of the dominant part of 

the system. 

(b) Design a robust adaptive law for estimating on-line these parameters. 

(c) Simulate your estimation scheme when a = 0.1,6 = l,pi = 50, P2 = 100 

and d = 0.02 sin 5f . 
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Table 8.7 Robust adaptive law with dead zone for the bilinear 

model 



Parametric 
model 


Same as in Table 8.5 


Adaptive law 


f ^ if em < -go 

9= \ -m if em > 50 
— e if em < qq 

e=^, ^ = e'^<|> + z^ 


Assumptions 


As in Table 8.5 


Normalizing 
signal 


Same as in Table 8.1 


Design 
variables 


5o>g; r = rT>o, 7>0 


Properties 


(i) e, em, p, 9, p, 9 G £oo; (ii) e, ew,, p, 
9 e cS(7?Vm2 + 5o); (iii) lim^^oo 0{t) = 9 



8.14 Consider the parameter error differential equation 

9 = — 7M 6 + jdu 

that arises in the estimation problem of Section 8.3.1 in the presence of a 
bounded disturbance d. 

(a) Show that for d = and u = — ^—j-, the equilibrium ^e = is u.s and 
a.s but not u.a.s. Verify that for 



d{t) = {l + t)--[--2{l + t)-^ 
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M = (1 + t)^2 and 7 = 1 we have y —> as t —> oo and 6{t) ^ c» as 
t —> c». 

(b) Repeat the same stabihty analysis for u = uq where uo 7^ is a constant, 
and show that for d = 0, the equihbrium flg = is u.a.s. Verify that 9{t) 
is bounded for any bounded d and obtain an upper bound for |0(t)|. 

8.15 Repeat Problem 8.12 for an adaptive law with (i) dead zone; (ii) projection. 

8.16 Consider the dynamic uncertainty 

7] = Au{s)u + Ay{s)y 

where A„, Aj, are proper transfer functions analytic in Re[s] > — -^ for some 
known Sq > 0. 

(a) Design a normalizing signal m that guarantees rj/m G £00 when 

(i) A„, Aj, are biproper. 

(ii) A„, Aj, are strictly proper. 

In each case specify the upper bound for — . 

(b) Calculate the bound for \ri\/m when 

g-rs _ I ^2 

(i) A„(s) = Ay{s) = li 



(s+1) 



2 



{n)Au{s) = ^-,Ay{s) 



^s + r^y^^'- (/is+l)2 
where < /i ^ 1 and < r ^ 1. 

8.17 Consider the system 

y 



(s + a)(^s+l) 

where 0<T<g;l,0<^<Cl and a,b are unknown constants. Obtain a 
parametric model for 0* = [&, a]^ by assuming r « 0,/i « 0. Show the effect 
of the neglected dynamics on the parametric model. 



Chapter 9 

Robust Adaptive Control 
Schemes 

9.1 Introduction 

As we have shown in Chapter 8, the adaptive control schemes of Chapters 4 
to 7 may go unstable in the presence of small disturbances or unmodeled 
dynamics. Because such modeling error effects will exist in any implementa- 
tion, the nonrobust behavior of the schemes of Chapters 4 to 7 limits their 
applicability. 

The purpose of this chapter is to redesign the adaptive schemes of the 
previous chapters and establish their robustness properties with respect to a 
wide class of bounded disturbances and unmodeled dynamics that are likely 
to be present in most practical applications. 

We start with the parameter identifiers and adaptive observers of Chap- 
ter 5 and show that their robustness properties can be guaranteed by de- 
signing the plant input to be dominantly rich. A dominantly rich input is 
sufficiently rich for the simplified plant model, but it maintains its richness 
outside the high frequency range of the unmodeled dynamics. Furthermore, 
its amplitude is higher than the level of any bounded disturbance that may 
be present in the plant. As we will show in Section 9.2, a dominantly rich 
input guarantees exponential convergence of the estimated parameter errors 
to residual sets whose size is of the order of the modeling error. 

While the robustness of the parameter identifiers and adaptive observers 
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of Chapter 5 can be established by simply redesigning the plant input with- 
out having to modify the adaptive laws, this is not the case with the adaptive 
control schemes of Chapters 6 and 7 where the plant input is no longer a 
design variable. For the adaptive control schemes presented in Chapters 6 
and 7, robustness is established by simply replacing the adaptive laws with 
robust adaptive laws developed in Chapter 8. 

In Section 9.3, we use the robust adaptive laws of Chapter 8 to mod- 
ify the MRAC schemes of Chapter 6 and establish their robustness with 
respect to bounded disturbances and unmodeled dynamics. In the case of 
the MRAC schemes with unnormalized adaptive laws, semiglobal bounded- 
ness results are established. The use of a dynamic normalizing signal in the 
case of MRAC with normalized adaptive laws enables us to establish global 
boundedness results and mean-square tracking error bounds. These bounds 
are further improved by modifying the MRAC schemes using an additional 
feedback term in the control input. By choosing a certain scalar design pa- 
rameter T in the control law, the modified MRAC schemes are shown to 
guarantee arbitrarily small £oo bounds for the steady state tracking error 
despite the presence of input disturbances. In the presence of unmodeled 
dynamics, the choice of r is limited by the trade-oif between nominal per- 
formance and robust stability. 

The robustification of the APPC schemes of Chapter 7 is presented in 
Section 9.5. It is achieved by replacing the adaptive laws used in Chapter 7 
with the robust ones developed in Chapter 8. 

9.2 Robust Identifiers and Adaptive Observers 

The parameter identifiers and adaptive observers of Chapter 5 are designed 
for the SISO plant model 

y = Go{s)u (9.2.1) 

where Gq{s) is strictly proper with stable poles and of known order n. In 
this section we apply the schemes of Chapter 5 to a more realistic plant 
model described by 

y = Gois)il + A^is))iu + du) (9.2.2) 

where G(s) = Go(s)(l + Am(s)) is strictly proper of unknown degree; A.m(s) 
is an unknown multiplicative perturbation with stable poles and du is a 
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bounded disturbance. Our objective is to estimate the coefficients of Go(s) 
and the states of a minimal or nonminimal state representation that cor- 
responds to Go(s), despite the presence of Amis), du- This problem is, 
therefore, similar to the one we would face in an actual application, i.e., 
(9.2.1) represents the plant model on which our adaptive observer design is 
based and (9.2.2) the plant to which the observer will be applied. 

Most of the effects of Am(s),du on the robustness and performance of 
the schemes presented in Chapter 5 that are designed based on (9.2.1) may 
be illustrated and understood using the following simple examples. 

Example 9.2.1 Effect of bounded disturbance. Let us consider the simple 
plant model 

y = 6*u + d 

where d is an external bounded disturbance, i.e., \d{i)\ < d(),\/t > 0, w G Coo and 6* 
is the unknown constant to be identified. The adaptive law based on the parametric 
model with d = is 

e = jeiu, ei = y-6u (9.2.3) 

which for rf = guarantees that ei, G C^ and ei,d G £2- If; iu addition, u is PE, 
then 6{t) —> 6* as t —> 00 exponentially fast. When d ^ 0, the error equation that 
describes the stability properties of (9.2.3) is 

e = -ju'^e + -/ud (9.2.4) 

where 9 = 6 — 6*. As shown in Section 8.3, if u is PE, then the homogeneous part 
of (9.2.4) is exponentially stable, and, therefore, the bounded input ^ud implies 
bounded 9. When u is not PE, the homogeneous part of (9.2.4) is only u.s. and 
therefore a bounded input does not guarantee bounded 9. In fact, as shown in 
Section 8.3, we can easily find an input u that is not PE, and a bounded disturbance 
d that will cause 9 to drift to infinity. One way to counteract parameter drift and 
establish boundedness for 9 is to modify (9.2.3) using the techniques of Chapter 8. 
In this section, we are concerned with the parameter identification of stable plants 
which, for accurate parameter estimates, requires u to be PE independent of whether 
we have disturbances or not. Because the persistent excitation of u guarantees 
exponential convergence, we can establish robustness without modifying (9.2.3). 
Let us, therefore, proceed with the analysis of (9.2.4) by assuming that u is PE 
with some level ao > 0, i.e., u satisfies 

t+T 

u dr > aoT, \/t > 0, for some T > 
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Then from (9.2.4), we obtain 

\0{t)\ < fcie^'^"''*|^(0)| + ^(1 - e'-'""*) sup \u{T)d{T)\ 

for some constants ki,aQ > 0, where a^ depends on aQ. Therefore, we have 

fci fci 

hm sup|0(t)| < -4- lim sup |u(T)d(T)| = ^ sup |M(T)d(T)| (9.2.5) 

The bound (9.2.5) indicates that the parameter identification error at steady state 
is of the order of the disturbance, i.e., as d ^ the parameter error also reduces 
to zero. For this simple example, it is clear that if we choose u = uq, where uq is 
a constant different from zero, then ckq = w§,A:i = 1; therefore, the bound for |^| 
is sup( \d{t)\/u(,. Thus the larger the uq is, the smaller the parameter error. Large 
Mo relative to \d\ implies large signal-to- noise ratio and therefore better accuracy of 
identification. 

Example 9.2.2 (Unmodeled Dynamics) Let us consider the plant 

y = r(l-hA,„(s))M 

where Am(s) is a proper perturbation with stable poles, and use the adaptive law 
(9.2.3) that is designed for Am(s) = to identify 9* in the presence of Am(s). The 
parameter error equation in this case is given by 

= -ju'^0 + juri, rj = e*Ara{s)u (9.2.6) 

Because u is bounded and Am(s) is stable, it follows that rj G Coo and therefore 
the effect of Am(s) is to introduce the bounded disturbance term rj in the adaptive 
law. Hence, if u is PE with level ag > 0, we have, as in the previous example, that 

fci 
lim sup|0(r)| < — ^ sup |M(t)?7(i)| 

The question now is how to choose u so that the above bound for \9\ is as small 
as possible. The answer to this question is not as straightforward as in Example 
9.2.1 because rj is also a function of u. The bound for \6\ depends on the choice 
of u and the properties of Am(s). For example, for constant u = mq 7^ 0, we have 
OfQ = ul.ki = 1 and ry = Am(s)uo, i-e., limi^oo |'7(^)| = |A„(0)||mo|, and, therefore, 

lim sup|e'(T)| < |A„(0)| 

If the plant is modeled properly, Am(s) represents a perturbation that is small (for 
s = jui) in the low-frequency range, which is usually the range of interest. Therefore, 
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for u = Mo, we should have |A„i(0)| small if not zero leading to the above bound, 
which is independent of Uq. Another choice of a PE input is u = cosLUot for some 
loq 7^ 0. For this choice of u, because 

e Jo =e ^^ ^'^0 ' = e * '^o e * <e * 

(where we used the inequality t + ^'"^""* > 0,Vt > 0) and sup^ \r]{t)\ < \A„,{jujo)\, 
we have 

lim sup|^(t)| <4|A„(jtJo)| 

t-»oo ^>t 

This bound indicates that for small parameter error, ojq should be chosen so that 
|Am(jLjJo)| is as small as possible. If Am(s) is due to high frequency unmodeled 
dynamics, |Am(jaJo)| is small provided luq is a low frequency. As an example, 
consider 



A„(s) 



1 + US 



where /i > is a small constant. It is clear that for low frequencies | Am(ja;) | = O(y^) 
and |A„i(j/u;)| ^ 1 as w ^ c». Because 

|A™(jtJo)| 



it follows that for ojq = -, we have A„i(j/ljo)| = ^ whereas for wq < - we have 
|Am(jLjJo)| = 0{fi). Therefore for accurate parameter identification, the input signal 
should be chosen to be PE but the PE property should be achieved with frequencies 
that do not excite the unmodeled dynamics. For the above example of Am{s), 
u = uq does not excite Amis) at all, i.e., Am(0) = 0, whereas for u = sinuiot with 
cjQ <C ^ the excitation of Am(s) is small leading to an O(y^) steady state error for 
l^'l- V 

In the following section we define the class of excitation signals that 
guarantee PE but with frequencies outside the range of the high frequency 
unmodeled dynamics. 

9.2.1 Dominantly Rich Signals 

Let us consider the following plant: 

y = Gois)u + Aais)u (9.2.7) 
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where Go(s), Aa{s) are proper and stable, Aa(s) is an additive perturbation 
of the modeled part Go(s). We like to identify the coefficients of Go(s) by 
exciting the plant with the input u and processing the I/O data. 

Because Aa{s)u is treated as a disturbance, the input u should be chosen 
so that at each frequency coi contained in u, we have |Go(jci-'j)| ^ \Aa{juJi)\. 
Furthermore, n should be rich enough to excite the modeled part of the 
plant that corresponds to Go(s) so that y contains sufficient information 
about the coefficients of Go(s). For such a choice of u to be possible, the 
spectrums of Go{s) and Aa(s) should be separated, or \Go{juj)\ :§> |Aa(jti;)| 
at all frequencies. If Go{s) is chosen properly, then |Aa(jti;)| should be small 
relative to \Go{juj) \ in the frequency range of interest. Because we are usually 
interested in the system response at low frequencies, we would assume that 
|Go(jci;)| ^ |A(i(ja;)| in the low-frequency range for our analysis. But at high 
frequencies, we may have jGoO"^)! being of the same order or smaller than 
|A(j(ja;)|. The input signal u should therefore be designed to be sufficiently 
rich for the modeled part of the plant but its richness should be achieved 
in the low-frequency range for which |Go(ii^)| ^ \Aa{juj)\. An input signal 
with these two properties is called dominantly rich [90] because it excites 
the modeled or dominant part of the plant much more than the unmodeled 
one. 

Example 9.2.3 Consider the plant 

6 1 - 2ms , ^ 

y= ^ ,^ u (9.2.8) 

s + a 1 -I- /is 

where /i > is a small constant and a > 0, 6 are unknown constants. Because /i is 
small, we choose Go{s) = j^ as the dominant part and rewrite the plant as 

1 1 u = u + Aa{lJ,s, s)u 



where 



s-|-a\ l-|-/is/ s + a 

Sbfis 



Aa{ns,s) 



{1 + ^is){s + a) 
is treated as an additive unmodeled perturbation. Because 

Go(juja) = -^- — -, \Aa(jfJ.ujo,]ujo) = r^- — jtt:;— — ^"^V 
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it follows that |Go(i^o)| 3> \Aa{jfJ.uJo, jluq)] provided that 

|wo|< 



VSfi 



Therefore, the input u = sincuot qualifies as a doniinantly rich input of order 2 for 
the plant (9.2.8) provided < ujq < 0(l//i) and ji is small. If o^g = -, then 



and 



|Go(ju;o)l' 



^262 



/i2a2 + 1 
962^2 



l: 



0(/x2 



> \G„{jco„)\' 



2(^2^2 

Hence, for ojo > 0{-), the input u = sm{uJot) is not dominantly rich because it 
excites the unmodeled dynamics and leads to a small signal to noise ratio. 

Let us now examine the effect of the dominantly rich input u = sm(u;oi), with 
< ciJo < 0(l//i), on the performance of an identifier designed to estimate the 
parameters a, b of the plant (9.2.8). Equation (9.2.8) can be expressed as 



z = 6*^4) + r] 



(9.2.9) 



where 



-y, 4> 



s + X' 
A > is a design parameter and 

V = 



1 



1 



s + X s + X 



9* = [6, a]^ 



Sbfis 
(s + A)(l + ^s)' 



is the modeling error term, which is bounded because u G C^c and A,/i > 0. The 
gradient algorithm for estimating 6* when ry = is given by 



e = Te(l) 

e = z — z, z 



e' 



(9.2.10) 



The error equation that describes the stability properties of (9.2.10) when applied 
to (9.2.9) with ry 7^ is given by 



6 ■ 



-V(l)(t)^e + Y(t>'q 



(9.2.11) 



Because e Ceo , it follows from the results of Chapter 4 that if </> is PE with level 
ao > 0, then the homogeneous part of (9.2.11) is exponentially stable which implies 
that 



lim sup|0(r)| < — aup\<f){t)T]{t)\ 



T>t 



(3o 



(9.2.12) 



9.2. ROBUST ADAPTIVE OBSERVERS 



641 



where c = ||r|| and f3o depends on F, ckq in a way that as ao —> 0, (3q —> (see proof 
of Theorem 4.3.2 in Section 4.8). Therefore, for a smaU error bound, the input u 
should be chosen to guarantee that is PE with level ag > as high as possible 
(without increasing sup^ |0(i)|) and with sup^ |ry(t)| as small as possible. 

To see how the unmodeled dynamics affect the dominant richness properties of 
the excitation signal, let us consider the input signal u = sinujot where ivq = 0{-). 
As discussed earlier, this signal u is not dominantly rich because it excites the high- 
frequency unmodeled dynamics. The loss of the dominant richness property in this 
case can also be seen by exploring the level of excitation of the signal (j). If we 
assume zero initial conditions, then from the definition of (j), we can express (j) as 



Ai{uja) sm{ujot + ipi) 
A2{uJo) sm{ujot + ip2) 



where 



Ai{ujo) 



^2(^0) 



\b\^TTW^> 



and ipi, ip2 also depend on ujq. Thus, we can calculate 



t+- 



(f>{T)<P^ {T)dT= 



CJQ 



A\ AiA2Cos{ipi 

AiA2Cos{ipi - 1P2) 



42 
^2 



V2) 



(9.2.13) 



For any i > and T > 2^, it follows from (9.2.13) that 



1 /•*+^ 

tL ' 



(t>{T)<t)^ {T)dT 



t+(l+l)l 



< 




1 / riTTT 

T\ ujo ' ujoX ^i^2Cos(<^i - 932) 



(fxf^dr ■ 



Al 



t+T 



t + TlT 



dT 



AiA2COs{lPi 



<y22j 



^2 



where ht is the largest integer that satisfies ut < -^ 



By noting that f^r < 5 



and 



Tujo 



it follows that 



t+T 



(f>{T)<P^ {T)dT < 



< 



Al 

A1A2 COs((/3l - 


-V2) 


AiA2Cos{ipi - 
^2 


-^2) 


' Aj ■ 











42 

^2 



for any constant a > 2. Taking luq 
we have 



- for some constant c > (i.e., ujq = 0{-) 



Al 



M 



|6|Vl + 4c2^' 



2, ,2 



Vc2 + A2/x2 



V(c2 + A2/z2)(c2 + a2/x2)(l + C^) 
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which impUes that 

1 /■*+'^ 

-J 4>{T)^'^{T)dT<0{tl^)I (9.2.14) 

for all /i e [0, fi*] where /i* > is any finite constant. That is, the level of PE of (p is 
of 0{fJ,^). As ^ ^ and l^jq ~^ oo, we have 7p J. (J){t)(J)^ {T)dT -^ and the level 
of PE vanishes to zero. Consequently, the upper bound for limj^oo sup^^ l^(''")l 
given by (9.2.12) will approach infinity which indicates that a quality estimate for 
6* cannot be guaranteed in general if the nondominantly rich signal u = sinuj^t 
with ojo = 0{-) is used to excite the plant. 

On the other hand if u = sinuj^t is dominantly rich, i.e., < |u;o| < O(-), then 
we can show that the level of PE of (j) is strictly greater than 0{id) and the bound 
for sup( \ri{t)\ is of 0{^) (see Problem 9.1). V 

Example 9.2.3 indicates that if the reference input signal is dominantly 
rich, i.e., it is rich for the dominant part of the plant but with frequencies 
away from the parasitic range, then the signal vector (p in the adaptive law 
is PE with a high level of excitation relative to the modeling error. This 
high level of excitation guarantees that the PE property of 4){t) cannot be 
destroyed by the unmodeled dynamics. Furthermore, it is sufficient for the 
parameter error to converge exponentially fast (in the case of the gradient 
algorithm (9.2.10)) to a small residual set. 

Let us now consider the more general stable plant 

y = G'o(s)u + ^A„(/is, s)u + d (9.2.15) 

where Gq{s) corresponds to the dominant part of the plant and fj,Aa{f^s,s) 
is an additive perturbation with the property lim^^Q fj,Aa{f^s, s) = for 
any given s and d is a bounded disturbance. The variable ^ > is the 
small singular perturbation parameter that can be used as a measure of the 
separation of the spectrums of the dominant dynamics and the unmodeled 
high frequency ones. 

Definition 9.2.1 (Dominant Richness) A stationary signal u : TZ~^ >-^ TZ 
is called dominantly rich of order n for the plant (9.2.15) if (i) it consists of 
distinct frequencies uji,uj2, ■ ■ ■ ,ujn where N > ^; (ii) tOi satisfies 

\uJi\ < O i-j , \uji-uJk\> 0{fi), fori^k; i,k = 1,...,N 
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and (in) the amplitude of the spectral line at coi defined as 
U{uJi) = lim i / u{T)e-^^^^dT Vt > 

satisfies 

\Uiu^)\>Oifi) + Oid), i = l,2,...,N 

For example, the input u = AisinuJit + A2sinu)2t is dominantly rich of 
order 4 for the plant (9.2.15) with a second order Gq{s) and d = provided 
\uji - W2I > 0(/i); |a;i|, \oj2\ < O(^) and \Ai\, \A2\ > 0(/i). 

9.2.2 Robust Parameter Identifiers 

Let us consider the plant 

y = Go(s)(l + fiAmifJ-s, s))u = Gois)u + fiAaifis, s)u (9.2.16) 

where 

s"-+an-is^ '-+ hao Rp{s) 

and Go{s) is the transfer function of the modeled or dominant part of the 
plant, Am(/xs,s) is a multiplicative perturbation that is due to unmodeled 
high frequency dynamics as well as other small perturbations; ^ > and 
lim^^o /^Aa(AiS,s) = for any given s. The overall transfer function is 
assumed to be strictly proper with stable poles. Our objective is to identify 
the coefficients of Gq{s) despite the presence of the modeling error term 
nAa{ns,s)u. 

As in the ideal case, (9.2.16) can be expressed in the linear parametric 
form 

z = e*^c^ + ^ir] (9.2.17) 

where 0* = [bm, • . • , 60, On-i, • • • , ao]^, 



A(s 



■y, 



Ms) "' Ais) y 



T]= -^Arr,{^iS,s)u 

A{s) 



ai{s) = [s*, s* ^, . . . , 1]^ and A(s) is a Hurwitz polynomial of degree n. As 
shown in Chapter 8, the adaptive law 

e = Te(j), e = z-z, z = 6*^0 (9.2.18) 
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developed using the gradient method to identify 6* on-hne may not guarantee 
the boundedness of 6 for a general class of bounded inputs u. If, however, 
we choose u to be dominantly rich of order n + m + 1 for the plant (9.2.16), 
then the following theorem establishes that the parameter error 6(t) — 6* 
converges exponentially fast to a residual set whose size is of 0{l-i)- 

Theorem 9.2.1 Assume that the nominal transfer function Go{s) has no 
zero-pole cancellation. If u is dominantly rich of order n + m + 1, then there 
exists a fi* > such that for fj, e [0,;U*), the adaptive law (9.2.18) or any 
stable adaptive law from Tables J^.2, J^.3, and 4-5, with the exception of the 
pure least-squares algorithm, based on the parametric model (9.2.17) with 
ry = guarantees that €,9 ^ Coo and 9 converges exponentially fast to the 
residual set 

ne = {9\ \9-9*\ < c/x} 

where c is a constant independent of n. 

To prove Theorem 9.2.1 we need to use the following Lemma that gives 
conditions that guarantee the PE property of (^ for /x 7^ 0. We express the 
signal vector <f) as 

4) = Hq{s)u + nHi{ns,s)u (9.2.19) 

where 

Ho{s) = ^^ [a^(s),-a^_i(s)Go(s)] 
Hi{fis, s) = J—— [0, . . . , 0, -a„_i(s)Go(s)Am(^s, s)J 

Lemma 9.2.1 Let u : TZ'^ i—i-TZbe stationary and Hq(s), Hi(ij.s,s) satisfy 
the following assumptions: 

(a) The vectors Ho(juJi), Hq{juj2), ■■■, Ho(juJn) are linearly independent 

on C" for all possible coi, uj2, . . . , oJn ^11, where n = n + m + 1 and 
LOi / LOk for i / k. 

(b) For any set {uji,uJ2, ■ ■ . ,uJn} satisfying \uJi — uJk\ > 0(fi) for i ^ k and 

\uji\ < O(^), we have |det(-H')| > 0(/x) where H = [Ho{juji), Hq{ju>2), 

■■■,Ho{ju)n)]. 
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(c) \Hi(jiJ,uj,JLu)\ < c for some constant c independent of // and for all 

to en. 

Then there exists a fi* > such that for fi e [0, /x*), (p is PE of order n with 
level of excitation ai > 0(/i) provided that the input signal u is dominantly 
rich of order n for the plant (9.2.16). 

Proof of Lemma 9.2.1: Let us define 

4)o = Ha{s)u, (f>i = Hi{fis,s)u 

Because (j)o is ttie signal vector for ttie ideal case, i.e., Ho{s) does not depend on /i, 
u being sufficiently rich of order n together with the assumed properties (a), (b) of 
Ho{s) imply, according to Theorem 5.2.1, that cpo is PE with level ao > and ao 
is independent of /x, i.e., 

-J MT)4>J{r)dT>aoI (9.2.20) 

Vi > and some T > 0. On the other hand, because Hi{fis,s) is stable and 
\Hi{jiioj,j(jj)\ < c for all LO eTZ, we have (pi G £oo and 

iy Mr)^J{r)dT<l3I (9.2.21) 

for some constant /3 which is independent of /i. Note that 

-J 0(T),/)T(T)dr = -J {Mr) + ^^Mr)M{r) + ^^^J{T))dr 

where the second inequality is obtained by using [x + y){x + y)^ > ^ VV^ , we 

obtain that 

^l HTH''ir)dT>^I-fi'pi 



which implies that (p has a level of PE ai = ^, say, for /i G [0, fi*) where /i* = <,/ f% 



Lemma 9.2.1 indicates that if u is dominantly rich, then the PE level of 
], the signal vector associated with the dominant part of the plant, is much 
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higher than that of /U0i, the signal vector that is due to the unmodeled part 
of the plant, provided of course that /x is relatively small. The smaller the 
parameter n is, the bigger the separation of the spectrums of the dominant 
and unmodeled high frequency dynamics. 

Let us now use Lemma 9.2.1 to prove Theorem 9.2.1. 
Proof of Theorem 9.2.1 The error equation that describes the stability properties 
of the parameter identifier is given by 

e = -r(j)(t>'^9 + fiTcpT] (9.2.22) 

where ^ = ^ — ^* is the parameter error. Let us first assume that all the conditions of 
Lemma 9.2.1 are satisfied so that for a dominantly rich input and for all ^ G [0, /i*), 
the signal vector is PE with level ai > 0{fJ,). Using the results of Chapter 4 we 
can show that the homogeneous part of (9.2.22) is u.a.s., i.e., there exists constants 
a > 0,/3 > independent of /i such that the transition matrix $(t, io) of the 
homogeneous part of (9.2.22) satisfies 

||'5(i,to)|| </9e-"(*-*") (9.2.23) 

Therefore, it follows from (9.2.22), (9.2.23) that 

|^(f)| <ce-"* + ^c, VAie[0,/i*) 

where c > is a finite constant independent of /i, which implies that d,e & Coo and 
9{t) converges to the residual set TZ^ exponentially fast. 

Let us now verify that all the conditions of Lemma 9.2.1 assumed above are 
satisfied. These conditions are 

(a) Hq{jloi), . . . , Ho{JLL!n) are linearly independent for all possible wi, u;2, • . • , Wh 

where uji ^ cok, i,k = l,...,n; n = n + m + I 

(b) For any set {uji,uj2, . . . ,ujn} where jciJi — u;fe| > 0(/i), i ^ k and \ijJi\ < O(-), 

we have 

\det{[Ho{JLo,),Ho{juj2),---,H„{jco^)]}\ > 0{^l) 

(c) \Hi{fijuj,ju!)\ < c for all LU e TZ 

It has been shown in the proof of Theorem 5.2.4 that the coprimeness of the 
numerator and denominator polynomials of Go(s) implies the linear independence 
of Ho{juJi),Ho{juj2), . . . , Ho^jiVn) for any wi, tJ2, • ■ • , ^n with uJi ^ ujk and thus (a) 
is verified. From the definition of Hi{iJ,s, s) and the assumption of Go(s)A,„(/is, s) 
being proper, we have \Hi{^juj,juj)\ < c for some constant c, which verifies (c). 
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To establish condition (b), we proceed as follows: From the definition of Ho{s), 
we can write 



Ho{s) = Qc 



1 



A{s)Rp{s) 



where Qq G j^nxn ^g ^ constant matrix. Furthermore, Qq is nonsingular, otherwise, 
we can conclude that Hq{ju!i), Hq{juj2), ■ ■ ■ , HQ{ju;n) are linearly dependent that 
contradicts with (a) which we have already proven to be true. Therefore, 

[Ho{juJi),...,Ha{juJn)] 



1 



J^2 
1 



1 



diag 



K{juJi)Rp{juJi) 



(9.2.24) 



Noting that the middle factor matrix on the right hand side of (9.2.24) is a Van- 
dermonde matrix [62], we have 



det {[//o(M), • • • , Hoiiujn)]} = det(Qo) \{ 



n (-^'^^ ~ ^^k) 



and, therefore, (b) follows immediately from the assumption that \uji — ujf^\> 0{fi). 

a 



Theorem 9.2.1 indicates that if the input u is doniinantly rich of order 
n + m + 1 and there is sufficient separation between the spectrums of the 
dominant and unmodeled high frequency dynamics, i.e., fi is small, then the 
parameter error bound at steady state is small. The condition of dominant 
richness is also necessary for the parameter error to converge exponentially 
fast to a small residual set in the sense that if u is sufficiently rich but not 
dominantly rich then we can find an example for which the signal vector (p 
loses its PE property no matter how fast the unmodeled dynamics are. In 
the case of the pure least-squares algorithm where the matrix T in (9.2.22) 
is replaced with P generated from P = —P'^^^P, we cannot establish the 
u.a.s. of the homogeneous part of (9.2.22) even when (j) is PE. As a result, 
we are unable to establish (9.2.23) and therefore the convergence of to a 
residual set even when u is dominantly rich. 
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9.2.3 Robust Adaptive Observers 

In this section we examine the stabiUty properties of the adaptive observers 
developed in Chapter 5 for the plant model 



y = Go{s)u 
when applied to the plant 

y = Go(s)(l + fiAmifis, s))u 



(9.2.25) 



(9.2.26) 



with multiplicative perturbations. As in Section 9.2.2, the overall plant 
transfer function in (9.2.26) is assumed to be strictly proper with stable 
poles and lim^^o /^G'o(s)Am(;US, s) = for any given s. A minimal state- 
space representation of the dominant part of the plant associated with Go(s) 
is given by 

In-l 



•Jy (X I ^p^i "^ Ct ^— '*^ 





y = [l,0,...,0]xa + fiV 
7] = Gois)Amins,s)u 



(9.2.27) 



Because the plant is stable and u G £00 the effect of the plant perturbation 
appears as an output bounded disturbance. 

Let us consider the adaptive Luenberger observer designed and analyzed 
in Section 5.3, i.e.. 



X = A(t)x + bp(t)u + K(t){y-y), £ e 7^" 
y = [l,0,...,0]x 

where x is the estimate of Xn, 



(9.2.28) 



A{t) 



In-l 





, K(t) = a* — hp 



ap,bp are the estimates of ap,bp, respectively, and a* £ TZ^ is a constant 
vector, and such that 



A* 



In-l 
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is a stable matrix. It follows that the observation error x = Xa — x satisfies 

X = A*x — bpU + dpH + fi(ap — a*)r] (9.2.29) 

where A* is a stable matrix; CLp = Up — Up, bp = bp — bp are the parameter 
errors. The parameter vectors ap,bp contain the coefficients of the denomi- 
nator and numerator of Go{s) respectively and can be estimated using the 
adaptive law described by equation (9.2. f8) presented in Section 9.2.2 or 
any other adaptive law from Tables 4.2, 4.3. The stability properties of 
the adaptive Luenberger observer described by (9.2.28) and (9.2. fS) or any 
adaptive law from Tables 4.2 and 4.3 based on the parametric model (9.2.17) 
are given by the following theorem: 

Theorem 9.2.2 Assume that the input u is dominantly rich of order 2n 
for the plant (9.2.26) and Gq{s) has no zero-pole cancellation. The adap- 
tive Luenberger observer consisting of equation (9.2.28) with (9.2.18) or any 
adaptive law from Tables 4-2 and 4-3 (with the exception of the pure least- 
squares algorithm) based on the parametric model (9.2.17) with n = applied 
to the plant (9.2.26) with /i / has the following properties: There exists a 
fi* > such that for all ji e [0, /i*) 

(i) All signals are u.b. 

(ii) The state observation error x and parameter error 9 converge exponen- 
tially fast to the residual set 

TZe = \x,9 \x\ + \6\ < c/i > 

where c> is a constant independent of /x. 

Proof: The proof follows directly from the results of Section 9.2.2 where we have 
established that a dominantly rich input guarantees signal boundedness and expo- 
nential convergence of the parameter estimates to a residual set where the parameter 
error 6 satisfies \6\ < cfi provided fi G [0,/i*) for some /i* > 0. Because |6p|,|ap| 
converge exponentially to residual sets whose size is of 0(/x) and u, y, rj are bounded 
for any ^ G [0, /z*), the convergence of x, 6 to the set TZe follows directly from the 
stability of the m.atrix A* and the error equation (9.2.29). □ 
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Theorem 9.2.2 shows that for stable plants, the combination of a state 
observer with an adaptive law from Tables 4.2 and 4.3 developed for modeling 
error and disturbance free parametric models leads to a robust adaptive 
observer provided that the input signal u is restricted to be dominantly 
rich. If u is not dominantly rich, then the results of Theorem 9.2.2 are no 
longer valid. If, however, instead of the adaptive laws of Tables 4.2 and 4.3, 
we use robust adaptive laws from Tables 8.1 to 8.4, we can then establish 
signal boundedness even when u is not dominantly rich. Dominant richness, 
however, is still needed to establish the convergence of the parameter and 
state observation errors to residual sets whose size is of the order of the 
modeling error. As in the case of the identifiers, we are unable to establish 
the convergence results of Theorem 9.2.1 for the pure least-squares algorithm. 

9.3 Robust MRAC 

In Chapter 6, we designed and analyzed a wide class of MRAC schemes 
for a plant that is assumed to be finite dimensional, LTI, whose input and 
output could be measured exactly and whose transfer function Go{s) satisfies 
assumptions PI to P4 given in Section 6.3.1. We have shown that under these 
ideal assumptions, an adaptive controller can be designed to guarantee signal 
boundedness and convergence of the tracking error to zero. 

As we explained in Chapter 8, in practice no plant can be modeled ex- 
actly by an LTI finite-dimensional system. Furthermore, the measurement 
of signals such as the plant input and output are usually contaminated with 
noise. Consequently, it is important from the practical viewpoint to exam- 
ine whether the MRAC schemes of Chapter 6 can perform well in a realistic 
environment where Go{s) is not the actual transfer function of the plant 
but instead an approximation of the overall plant transfer function, and the 
plant input and output are affected by unknown disturbances. In the pres- 
ence of modeling errors, exact model-plant transfer function matching is no 
longer possible in general and therefore the control objective of zero tracking 
error at steady state for any reference input signal may not be achievable. 
The best one can hope for, in the nonideal situation in general, is signal 
boundedness and small tracking errors that are of the order of the modeling 
error at steady state. 

In this section we consider MRAC schemes that are designed for a simpli- 



9.3. ROBUST MRAC 651 

fied model of the plant but are applied to a higher-order plant. For analysis 
purposes, the neglected perturbations in the plant model can be character- 
ized as unstructured uncertainties of the type considered in Chapter 8. In 
our analysis we concentrate on multiplicative type of perturbations. The 
same analysis can be carried out for additive and stable factor perturbations 
and is left as an exercise for the reader. 
We assume that the plant is of the form 

yp = Go{s){l + A„^{s)){uj, + du) (9.3.1) 

where Go(s) is the modeled part of the plant, Amis) is an unknown mul- 
tiplicative perturbation with stable poles and du is a bounded input dis- 
turbance. We assume that the overall plant transfer function and Gq are 
strictly proper. This implies that GoAm is also strictly proper. We design 
the MRAC scheme assuming that the plant model is of the form 

yp = Go{s)up, Gois) = kp^^ (9.3.2) 

where Go(s) satisfies assumptions PI to P4 in Section 6.3.1, but we imple- 
ment it on the plant (9.3.1). The effect of the dynamic uncertainty Amis) 
and disturbance d„ on the stability and performance of the MRAC scheme 
is analyzed in the next sections. 

We first treat the case where the parameters of Gq(s) are known exactly. 
In this case no adaptation is needed and therefore the overall closed-loop 
plant can be studied using linear system theory. 

9.3.1 MRC: Known Plant Parameters 

Let us consider the MRC law 

developed in Section 6.3.2 and shown to meet the MRC objective for the 
plant model (9.3.2). Let us now apply (9.3.3) to the actual plant (9.3.1) and 
analyze its properties with respect to the multiplicative uncertainty Am{s) 
and input disturbance du- 
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Figure 9.1 Closed-loop MRC scheme. 

Following the analysis of Section 6.3.2 (see Figure 6.4), the closed-loop 
plant is represented as shown in Figure 9.1 where 



C{s) 



Ais)4 



A(s) - ei ' a{s) 



-, F{s) 



91 ' a{s) + eiA{s) 



The closed-loop plant is in the form of the general feedback system in 
Figure 3.2 analyzed in Chapter 3. Therefore using equation (3.6.1) we have 



u„ 



Vp 



C 



-FCC 



1 + FCG 1 + FOG 
GG G 



1 + FCG 1 + FCG 



r 
du 



(9.3.4) 



where G = Go(l + Am) is the overall transfer function which is assumed 
to be strictly proper. The stability properties of (9.3.4) are given by the 
following Theorem: 



Theorem 9.3.1 Assume that 6* = [6i ,62 ,63,Cq\ is chosen so that for 
Am('S) = 0,du = 0, the closed-loop plant is stable and the matching equation 



CGn 



1 + FCGg 



Wrr 



where Wm{s) = km p'" ^X is the transfer function of the reference model, is 
satisfied, i.e., the MRC law (9.3.3) meets the MRC objective for the simplified 
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plant model (9.3.2). If 

efa{s) + eiA{s) kp 



Ms) 



kn 



Wm{s)l\.m{s] 



< 1 



(9.3.5) 



then the closed-loop plant is internally stable. Furthermore there exists a 
constant 6* > such that for any S e [0, S*] the tracking error ei = yp — y-m 
satisfies 

lim sup |ei(T)| < Aro + cdo (9.3.6) 



t^oo 



T>t 



where ro, do are upper bounds for \r(t)\, \du{t)\, c> is a finite constant 
Wmis)iAis) - Cti.s))Rp(s) 



A 



Zp{s)[kn,A{s) - kpWm{s)Dl{s)Am{s)] 



Wrn{s)Arn{s) 



25 



with Cl(s) = 0'fa(.s),Dl(s) = 62'^ a (s) + 6i^A(s) and ym = Wmis)r is the 
output of the reference model. 

Proof A necessary and sufficient condition for r, d^ G C^c to imply that yp, Up G C^ 
is that the poles of each element of the transfer matrix in (9.3.4) are in C^ . It can 
be shown using the expressions of F, C and G that the characteristic equation of 
each element of the transfer matrix in (9.3.4) is given by 



{K-Cl)Rp-DlkpZp{l + /\r 







(9.3.7) 



Using the matching equation (6.3.13), i.e., (A — Ci)Rp — kpD\Zp = Zph^Rm, the 
characteristic equation (9.3.7) becomes 



Zp{AoRm - kpDlAr 







where Aq is a factor of A = AoZm- Because Zp is Hurwitz, we examine the roots of 

Ao-R„ - kpDlArn = 

which can be also written as 

F>lkp _ kpDlWniAr 



1 



AqRj, 



-Ar 



1 



/Crri,-/*- 







Because the poles of —^ — ^ — — are in C , it follows from the Nyquist criterion that 
for all Am satisfying 



kp Dl{s)Wm{s)Am{s) 



kri 



A{s) 



< 1 



(9.3.8) 
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the roots of (9.3.7) are in C . Hence, (9.3.8), (9.3.4) imply that for r, d„ G C^o, we 
have Up, Up G Coo- 

Because F{s) = — ^, j^ /! has stable poles and r,du,Up,yp G £00, it follows from 
Figure 9.1 that all signals in the closed- loop scheme are bounded. 

The tracking error ei = j/p — i/m is given by 



ei 



WmAr^ 



Go(l + A, 



-rf„ 



l + FCGo{l + Am) l + FCGo{l + Ar__, 
Substituting for F, C, Go and using the matching equation, we have 
Wm{A-C^)Rp ^^^ ^ , A:p(A-Ci*)W„(l + A,„ 



ei 



Zp{kmA - kpWmDlAr 



-Wm. Ar 



(fc„A - kpWrr,DlAr. 



(9.3.9) 



-du (9.3.10) 



Due to G{s),Gq{s) being strictly proper and the fact that Wm{s) has the same 
relative degree as Go(s), it follows that Wm{s)Am{s) is strictly proper, which implies 
that the transfer function ei(s)/r(s) is strictly proper and ei(s)/rf„(s) is proper. 
Furthermore, both ei(s)/r(s), ei(s)/(i„(s) have stable poles (due to (9.3.5)), which 
implies that there exists a constant S* > such that %^, 3H7T are analytic in 
Re[s] > — ^. Using the properties of the C2S norm. Lemma 3.3.2, (9.3.10) and the 
fact that r,du G £00, the bound for the tracking error given by (9.3.6) follows, n 



Remark 9.3.1 The expression for the tracking error given by (9.3.9) sug- 
gests that by increasing the loop gain FCGq, we may be able to im- 
prove the tracking performance. Because F, C, Gq are constrained by 
the matching equation, any changes in the loop gain must be performed 
under the constraint of the matching equation (6.3.13). One can also 
select A(s) and Wm{s) in an effort to minimize the -ffoo norm in the 
C2e bound for ei, i.e., 



|eif||2< 



Wm^Tn 



i+fcGqU+k 



n 2 + 



Go(l + A, 



l + FCGo(l + A, 



\d. 



'Ut\\2 



under the constraint of the matching equation (6.3.13). Such a con- 
strained minimization problem is beyond the scope of this book. 



Example 9.3.1 Let us consider the plant 

1 



y 



s + a 



{I + A^{s))u = G{s)u 



(9.3.11) 
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where G{s) is the overall strictly proper transfer function of the plant and A^ is 
a multiplicative perturbation. The control objective is to choose u such that all 
signals in the closed-loop plant are bounded and y tracks as close as possible the 
output yjn of the reference model 



Vn 



where a„nhm > 0. The plant (9.3.11) can be modeled as 

1 

y 



s + a 



(9.3.12) 



The MRC law based on (9.3.12) given by 

u= 6*y + b„ir 

where 6* = a — am meets the control objective for the plant model (9.3.12) exactly. 
Let us now implement the same control law on the actual plant (9.3.11). The 
closed-loop plant is given by 

6„(l-hA„(s)) 
s + a„i- 0*Am{s) 

whose characteristic equation is 

S+ flm - ^*A„(s) = 



1 ^^^^^ = 

Because g^"^ is strictly proper with stable poles, it follows from the Nyquist 
criterion that a sufficient condition for the closed-loop system to be stable is that 
Am(s) satisfies 



e*Am{s) 



S + Gn 



(a- am)A„(s) 



s + a„ 



The tracking error ei = y — y^ satisfies 



ei 



(s + a„) {s + a^- 0*Am{s)) 



< 1 



Am(s)r 



(9.3.13) 



Because r G C^o and the transfer function ei(s)/r(s) has stable poles for all A^ 
satisfying (9.3.13), we have that 

lim sup|ei(r)| < Arg 
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where \r{t)\ < vq and 
A 
Furthermore, 



{s + am + 0*) 



\eith< 






A„(s) 



2(5 



/ I \/i e*A,„(s) 



\rt\\2 



Therefore, the smaller the term 
tracking performance will be. 

Let us consider the case where 



| A„(s) | 
I s+a„ I 



Am(s) 



is, the better the stability margin and 
2/is 



1 + /iS 



and /i > is small, that arises from the parameterization of the nonminimum phase 
plant 



V 



1 — /is 



1 



1 



2fis 
{s + a){l + fis) s + a\ 1 + /is 

For this A„(s), condition (9.3.13) becomes 

(a — a„i) 2/is 



(9.3.14) 



which is satisfied provided 



{s + ttm) (1 + fJ-s) 



/i< 



< 1 



2\a- ajn\ 

Similarly, it can be shown that A = 0{fi), i.e., the faster the unmodeled pole and 
zero in (9.3.14) are, the better the tracking performance. As fi —> 0, A —> and 
therefore limj^oo sup^>j |ei(''")| ^0. V 



9.3.2 Direct MRAC with Unnormalized Adaptive Laws 

The adaptive control schemes of Chapter 6 designed for the simplified plant 
model (9.3.2) can no longer be guaranteed to be stable when applied to the 
actual plant (9.3. f) with A„j(s) / or d^ / 0. We have already demon- 
strated various types of instability that may arise due to the presence of 
modeling errors using simple examples in Section 8.3. The main cause of in- 
stability is the adaptive law that makes the overall closed-loop plant nonlin- 
ear and more susceptible to modeling error effects. We have already proposed 



9.3. ROBUST MRAC 657 

various types of modifications for changing the adaptive laws to counteract 
instabihties and improve performance in Chapter 8. In this section, we use 
some of these modification techniques to improve the robustness properties 
of the direct MRAC schemes with unnormahzed adaptive laws developed in 
Section 6.4. 

We start by considering the same plant as in Example 9.3. f, i.e., 

y = J—(l + A^is))u (9.3.15) 

s + a 

where a is unknown and u is to be chosen so that the closed-loop plant is 
stable and y tracks the output i/m of the reference model 

bm 
-r 



s + ar, 

as close as possible. The control law based on the modeled part of the plant 
obtained by neglecting Am(s) is given by 

u = ey + bmr (9.3.16) 

where 9 is to be generated by an adaptive law. Letting 6 = 6 — 9* where 
6* = a — ttm is the unknown controller parameter (see Example 9.3.1), we 
write the control law as 

u = 6*y + bmr + 6y 

and use it in (9.3.15) to obtain the closed-loop plant 

y = W{s){6y + bmr) 

where 

„w , 1 + A„(s) 1 + Amis) 

W [s) — — 



s + a- 6* -6* Amis) s + am -9* Amis) 

The condition for Wis) to have stable poles is the same as in the non- 
adaptive case (i.e., 6 = 0) and is given by 



9*Amis) 



S+ Qr, 



< 1 (9.3.17) 



oo 
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Defining tlie tracking error ei = y — y^, we obtain the error equation 

ei = W{s)ey + (w{s) —) h^r 

\ s + a„J 

or 

The ideal error equation obtained by setting Am(s) = is 

ei = 6y 

s + am 

which, based on the results of Chapter 4, suggests the adaptive law 

e = e = -7612/ (9.3.19) 

due to the SPR property of -^-—. As we showed in Chapter 4, the adaptive 
control law (9.3.16), (9.3.19) meets the control objective for the plant (9.3.15) 
provided A„j(s) = 0. 

The presence of Am(s) introduces an external unknown input that de- 
pends on Am,r and acts as a bounded disturbance in the error equation. 
Furthermore Am(s) changes the SPR transfer function that relates ei to Oy 
from ^ to W{s) as shown by (9.3.18). As we showed in Chapter 8, adap- 
tive laws such as (9.3.19) may lead to instability when applied to (9.3.15) due 
to the presence of the disturbance term that appears in the error equation. 
One way to counteract the effect of the disturbance introduced by Am(s) / 
and r / is to modify (9.3.19) using leakage, dead zone, projection etc. as 
shown in Chapter 8. For this example, let us modify (9.3.19) using the fixed 
a-modification, i.e., 

e = -^eiy--iae (9.3.20) 

where cr > is small. 

Even with this modification, however, we will have difficulty establishing 
global signal boundedness unless W{s) is SPR. Because W{s) depends on 
Am(s) which is unknown and belongs to the class defined by (9.3.17), the 
SPR property of W{s) cannot be guaranteed unless Am(s) = 0. Below we 
treat the following cases that have been considered in the literature of robust 
adaptive control. 
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Case I: W{s) Is SPR-Global Boundedness 

Assume that Am(s) is such that W{s) is guaranteed to be SPR. The error 
equation (9.3.18) may be expressed as 

e^ = W{s){6y + d) (9.3.21) 

where d = (l s+a ) ^™^ ^^ guaranteed to be bounded due to r e £oo 

and the stability of W~^{s) which is implied by the SPR property of W{s). 
The state-space representation of (9.3.21) given by 



e = Ace + Bc{Oy + d) 
ei = Cje 



J (9.3.22) 



where Cj {si — Ac) ^Bc = W{s) motivates the Lyapunov-hke function 

2 27 

with Pc = Pj > satisfies the equations in the LKY Lemma. The time 
derivative of V along the solution of (9.3.20) and (9.3.22) is given by 

V = —e qq e — UcC Let + eid — o69 

where Vc > 0, Lc = LJ > and q are defined by the LKY Lemma. We have 

V < -J/cAc|e|2 + c|e||d| - ctJ^I^ + a\e\\e*\ 

where c = ||C^||,Ac = Xmin{Lc)- Completing the squares and adding and 
subtracting aV , we obtain 

y<-ay+J^ + ^ (9.3.23) 

where a = min{^j;^,aj} and Ap = Xmax{Pc), which imphes that V and, 
therefore, e, 9, ei e £00 and that ei converges to a residual set whose size 
is of the order of the disturbance term \d\ and the design parameter a. If, 
instead of the fixed-cr, we use the switching a or the projection, we can verify 
that as Am{s) -^ 0, i.e., d ^ 0, the tracking error ei reduces to zero too. 

Considerable efforts have been made in the literature of robust adaptive 
control to establish that the unmodified adaptive law (9.3.19) can be used to 
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establish stability in the case where y is PE [85, 86]. It has been shown [170] 
that if W(s) is SPR and y is PE with level ag > 7o'^o + 7i where vq is an 
upper bound for \d(t)\ and 70, 7i are some positive constants, then all signals 
in the closed-loop system (9.3.18), (9.3.19) are bounded. Because 00,1^0 are 
proportional to the amplitude of r, the only way to generate the high level 
aQ of PE relative to vq is through the proper selection of the spectrum 
of r. If Ajnis) is due to fast unmodeled dynamics, then the richness of r 
should be achieved in the low frequency range, i.e., r should be dominantly 
rich. Intuitively the spectrum of r should be chosen so that |VF(ja;)| ^ 
|iy(JLij) — .^ I for all to in the frequency range of interest. 

An example of Amis) that guarantees W(s) to be SPR is Amis) = jfr~^ 
where /x > is small enough to guarantee that Amis) satisfies (9.3.17). 

Case II: Wis) Is Not SPR-Semiglobal Stability 

When Wis) is not SPR, the error equation (9.3.18) may not be the appro- 
priate one for analysis. Instead, we express the closed-loop plant (9.3.15), 
(9.3.16) as 

y = — — i0*y + bmr + 6y) ^ ^ — Am(s)n 

s + a s + a 

and obtain the error equation 

ei = —- i9y + Amis)u) 

S -]- CLfYi 



(9.3.24) 



or 

ei = -ttmei + 6y + r] 

T] = Amis)u = Amis)i9y + bmv) 

Let us analyze (9.3.24) with the modified adaptive law (9.3.20) 

= —'jeiy — ^aO 

The input r] to the error equation (9.3.24) cannot be guaranteed to be 
bounded unless u is bounded. But because u is one of the signals whose 
boundedness is to be established, the equation 77 = Am(s)n has to be ana- 
lyzed together with the error equation and adaptive law. For this reason, we 
need to express rj = Amis)u in the state space form. This requires to assume 
some structural information about Amis). In general Amis) is assumed to 
be proper and small in some sense. Amis) may be small at all frequencies. 
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i.e., Amis) = fiAi(s) where ^u > is a small constant whose upper bound 
is to be established and Ai(s) is a proper stable transfer function. Amis) 
could also be small at low frequencies and large at high frequencies. This is 
the class of Am{s) often encountered in applications where Amis) contains 
all the fast unmodeled dynamics which are usually outside the frequency 
range of interest. A typical example is 

Amis) = -T^^^ (9.3.25) 

1 + fis 

which makes (9.3.15) a second-order nonminimum-phase plant and Wis) in 
(9.3.18) nonminimum-phase and, therefore, non-SPR. To analyze the stabil- 
ity of the closed-loop plant with Amis) specified in (9.3.25), we express the 
error equation (9.3.24) and the adaptive law (9.3.20) in the state-space form 

ei = -ttmei + 6y + ri 

lif] = -7]- 2fiu (9.3.26) 

9 = — 7eiy — 'jaO 

Note that in this representation ^ = ^ r; = 0, i.e., the state 77 is a 
good measure of the effect of the unmodeled dynamics whose size is charac- 
terized by the value of ^. The stability properties of (9.3.26) are analyzed 
by considering the following positive definite function: 

F(ei,77,^~) = | + ^ + |(r? + ei)2 (9.3.27) 

For each /x > and some constants cq > 0, a > 0, the inequality 

F(ei,?7,^)<coM"'" 

defines a closed sphere £(^,a,co) in TZ^ space. The time derivative of V 
along the trajectories of (9.3.26) is 

V = -amcf - a69 - 7]'^ + ij,[ei - 2u]iri + ei) 

< -ame\- -^-v'^ + ^- + fic[ef + \eif + el + el\9\ + e\¥ + \ex\B^ 

+ Idll^l + |ei||^||7?| + |ei|-'^|??| + |ei| + |??| + r?^ + \e,^\\r^\ 

+ l^yll^l + l^l^^ + eflr^l + lei^^llr^l + l^l^^^leillrl + lr^llrl] (9.3.28) 
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for some constant c > 0, where the last inequahty is obtained by substituting 
for ei, u = 0y + 6y + bmr and taking bounds. Using the inequahty 2a/3 < 
a^ + /3^, the multiplicative terms in (9.3.28) can be manipulated so that after 
some tedious calculations (9.3.28) is rewritten as 



V < 



ttmei 



at 





2 


2 


'am 
. 2 


e^ 


'a 



2 



ri 



1 



Pic{\e\ + 1) 



Hc{el + |ei| + \e\ + 6*2 + |r?| + |ei||?7| + 1) 



/ic(|ei| + 1 + |ei||r/|) 



+ ^c|r| +/ic + 



irp 



(9.3.29) 



Inside £(^,a,Co), |ei|,|^| can grow up to 0(^~°) and \ri\ can grow up to 
0(;U~^/^~"). Hence, there exist positive constants ki, ^2, /ca such that inside 
£(/i, a, Co), we have 

|ei| < fci/i-", 1^1 < /C2iu-", |J7| < A;3^-^/2-a 
For all ei,r],9 inside C(fi,a,co) , (9.3.29) can be simplified to 



V < 



O-m 2 V 

■ 6i — 

/I i o 



4 ' V2 



/32/i 



l-a 



A.i/2-2"/3i 



/?3^ 



l-a 



(9.3.30) 



+^c|r| + HC + 



u6 



*2 



for some positive constants Pi, f32, Ps- If we now fix a > then for < a < 
1/4, there exists a ^u* > such that for each fi G (0, fi*] 

'^"^ -> ,,l/2-2a/3 ^ ~> n ,,1-a "^ ^ /^ ,,!-« 

-^ - 1^ ^1' 2 '^ ' 4 ^^^ 

Hence, for each /j, e (0, fi*] and ei,r],9 inside £(/U, a, cq), we have 



T^< 



Q-m 2 *? 



3*2 



-6*^ + 



+ fic\r\ + ;uc 



(9.3.31) 



On the other hand, we can see from the definition of V that 



V{ei,r], 
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where C4 = max{ ^ , — ,'2fJ-}. Thus, for any < /? < I/C4, we have 

y < -pV + — - + ^c|r|2 + fic 
Because r, r are uniformly bounded, we define the set 



Doifi) = \ ei,e,r] 



V{euv,0)<^ 



*2 



^" -|2 



which for fixed a and a and for sufficiently small /x is inside >C(/U, a, cq). Out- 
side Do(fi) and inside jC(/i, a, cq), F < and, therefore, V{ei,ri, 6) decreases. 
Hence there exist positive constants ci,C2 such that the set 

D{ii) = {ei,ri,e\\ei\ + \e\ < ci^'Mr?! < ca^-^-^/^j 

is inside C{fj,,a,co) and any solution ei(t),r](t),6{t) which starts in D{fi) 
remains inside C(fi, a, cq). Furthermore, every solution of (9.3.26) that starts 
from D(iJ,)\Do{fJ,) will enter Do(fi) at t = ti for some finite time ti and 
remain in Do{f^) thereafter. Similarly, any solution starting at t = from 
Do(fi) will remain in Do^fi) for all i > 0. 

The stability results obtained in this example are semiglobal in the sense 
that as /i ^ the size of -D(/x) becomes the whole space. 

The above analysis demonstrates that the unnormalized adaptive law 
with (T-modification guarantees a semiglobal boundedness result in the pres- 
ence of fast unmodeled dynamics. The speed of unmodeled dynamics is 
characterized by the positive scalar /x > in such a way that, as /i ^ 0, the 
unmodeled dynamics become infinitely fast and reduce to their steady-state 
value almost instantaneously. The region of attraction from which every so- 
lution is bounded and converges to a small residual set becomes the whole 
space as /x ^ 0. 

A similar stability result is established for the general higher order case 
in [85, 86] using the fixed cr-modification. Other modifications such as dead 
zone, projection and various other choices of leakage can be used to estab- 
lish a similar semiglobal boundedness result in the presence of unmodeled 
dynamics. 
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Case III: W{s) Is Not SPR-Method of Averaging: Local Stability 

The error system (9.3.18), (9.3.19) is a special case of the more general error 
system 

ei = W{s)e'^uj + d (9.3.32) 

0=-jeiLJ (9.3.33) 

that includes the case of higher order plants. In (9.3.32), W{s) is strictly 
proper and stable and d is a bounded disturbance. The signal vector uj G 7?,^" 
is a vector with the filtered values of the plant input and output and the 
reference input r. For the example considered above, uj = y. In the error 
system (9.3.32), (9.3.33), the adaptive law is not modified. 

With the method of averaging, we assume that the adaptive gain 7 > is 
sufficiently small (slow adaptation) so that for ei,uj bounded, 9 varies slowly 
with time. This allows us to approximate (9.3.32) with 

ei ^e'^W{s)uj + d 

which we use in (9.3.33) to obtain 

e = -'yuj(Wis)uj)'^e - -fujd (9.3.34) 

Let us consider the homogeneous part of (9.3.34) 

e = --fR{t)e (9.3.35) 

where R{t) = co{t){W{s)uj{t)) . Even though R{t) may vary rapidly with 
time, the variations of 6 are slow due to small 7. This fact allows us to 
obtain stability conditions for (9.3.35) in terms of sample averages 

Ri{T,) = ^ r R{t)dt, U = U-1 + T, 
Jj Jti-i 

over finite sample intervals < Tj < 00. We consider the case where R{t) = 
R{t + r) is bounded and periodic with period T > 0. By taking Tj = T, the 
value of ^ = Ri{T) is independent of the interval. It has been established 
in [3] that there exists a constant 7* > such that (9.3.35) is exponentially 
stable for 7 £ (0, 7*) if and only if 

minReAi(-R) >0, i = l,2,...,2n (9.3.36) 
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where R = 7p Jq R{t)dt. Condition (9.3.36) is equivalent to the existence of 
a matrix P = P > such that 

PR + R^P > 

When the above inequahty is satisfied for P = I, namely, 

R + R^>0 (9.3.37) 

its meaning can be explained in terms of the frequency content of uj by letting 



i=—oo 

where Q-i is the conjugate of Qi. Because 

OO 

i=— OO 

it follows that 

_ I j-T °o 

i?=-y uj{t){W{.s)Lo{t))^dt= Y. W{M)Q,Qli (9.3.38) 

i=— OO 

For R to be nonsingular, it is necessary that 

OO 

i=—oo 

which can be shown to imply that uj must be PE. Applying the condition 
(9.3.37) to (9.3.38) we obtain a signal dependent "average SPR" condition 

OO 

Y, Re{W{M)}Re[QiQl^]>0 (9.3.39) 

j = — OO 

Clearly, (9.3.39) is satisfied if to is PE and W{s) is SPR. Condition (9.3.39) 
allows JieW{juJi) < for some uJi provided that in the sum of (9.3.39), the 
terms with 'ReW(JLOi) > dominate. 

The exponential stability of (9.3.35) implies that 6 in (9.3.34) is bounded 
and converges exponentially to a residual set whose size is proportional to 



666 CHAPTER 9. ROBUST ADAPTIVE CONTROL SCHEMES 

the bounds for uj and d. Because uj consists of the filtered values of the plant 
input and output, it cannot be shown to be bounded or PE unless certain 
assumptions are made about the stability of the plant, the initial conditions 
ei(O),0(O) and disturbance d. Let u>m represent to when = 0, ei = 0. 
The signal uJm, often referred to as the ^^tuned solution," can be made to 
satisfy (9.3.39) by the proper choice of reference signal r. If we express 
UJ = LOm + e where e is the state of a state space representation of (9.3.32) 
with the same order as uj and ei = C e, then uj is bounded, PE and satisfies 
(9.3.39) provided e is sufficiently small. This can be achieved by assuming 
that the initial conditions e(O),0(O) and disturbance d are sufficiently small 
and the plant is stable. Therefore, the above stability result is local. Even 
though the above results are based on several restrictive assumptions, they 
are very valuable in understanding the stability and instability mechanisms 
of adaptive schemes in the presence of modeling errors. For further details on 
averaging and the extension of the above results to a wider class of adaptive 
schemes, the reader is referred to [3]. 

9.3.3 Direct MRAC with Normalized Adaptive Laws 

The MRAC schemes with normalized adaptive laws discussed in Section 6.5 
have the same robustness problems as those with the unnormalized adap- 
tive laws, i.e., they can no longer guarantee boundedness of signals in the 
presence of unmodeled dynamics and bounded disturbances. For MRAC 
with normalized adaptive laws, however, the robustification can be achieved 
by simply using the certainty equivalence principle to combine the MRC law 
with any one of the robust adaptive laws presented in Section 8.5. The design 
procedure is the same as that in the ideal case, that is, we use the same con- 
trol law as in the known parameter case but replace the unknown controller 
parameters with their on-line estimates generated by a robust adaptive law. 
The stability analysis of the resulting closed-loop adaptive scheme is also 
similar to the ideal case, with a few minor changes that incorporate the 
small-in- the- mean, instead of the C2, properties of 9 and e into the analysis. 
In this section, we first use an example to illustrate the design and stabil- 
ity analysis of a robust MRAC scheme with a normalized adaptive law. We 
then extend the results to a general SISO plant with unmodeled dynamics 
and bounded disturbances. 
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Example 9.3.2 Consider the following SISO plant 

y = J—{1 + A„,{s))u (9.3.40) 

s — a 

with a strictly proper transfer function, where a is unknown and Am{s) is a multi- 
plicative plant uncertainty. Let us consider the following adaptive control law 



-9y (9.3.41) 



jecj), 7 > 



z — z 



m^ = l + <j)^ (9.3.42) 



1 1 

(j) = -— y, z = e(j), z = y u 

where —a^ is the desired closed loop pole and 6 is the estimate of 9* = a + am- 

As we have shown in Chapter 8, when (9.3.41), (9.3.42) designed for the plant 

model 

1 

y = u 

s — a 

is applied to the plant (9.3.40) with Am{s) ^ 0, the plant uncertainty Am(s) 
introduces a disturbance term in the adaptive law that may easily cause 6 to drift 
to infinity and certain signals to become unbounded no matter how small Am{s) 
is. The adaptive control law (9.3.41), (9.3.42) is, therefore, not robust with respect 
to the plant uncertainty Am{s). This adaptive control scheme, however, can be 
made robust if we replace the adaptive law (9.3.42) with a robust one developed by 
following the procedure of Chapter 8 as follows: 

We first express the desired controller parameter 9* = a + am in the form of a 
linear parametric model by rewriting (9.3.40) as 

Z = 9*4) + 7] 

where z, (j) are as defined in (9.3.42) and 

V = — A„(s)m 

is the modeling error term. If we now assume that a bound for the stability margin 
of the poles of Am(s) is known, that is, A„i(s) is analytic in Re[s] > — -^ for some 
known constant 6q > 0, then we can verify that the signal m generated as 

rn^ = 1 + nis, iris = —SquIs + v? + y'^, ms(0) = 0, So < 2am (9.3.43) 



668 CHAPTER 9. ROBUST ADAPTIVE CONTROL SCHEMES 

guarantees that rj/m, cp/m G C^c and therefore quaUfies to be used as a normalizing 
signal. Hence, we can combine normalization with any modification, such as leak- 
age, dead zone, or projection, to form a robust adaptive law. Let us consider the 
switching-cr modification, i.e., 

= jecl) — asjO 
z-06 



(9.3.44) 

IIL- 

where cFs is as defined in Chapter 8. According to Theorem 8.5.4, the robust 
adaptive law given by (9.3.43), (9.3.44) guarantees e, em, 0,6 G £00 and e,em,9 € 
S I -^ j . Because from the properties of the C2S norm we have 



-A„(s) 



\v{t)\<A2\\ut\U, A2^ 

2<5o 

andm^ = l+||ut||25„ + ||yt|l25„> it follows that J^ < Aa- Therefore, e,em,e e 5(A^). 

We analyze the stability properties of the MRAC scheme described by (9.3.41), 
(9.3.43), and (9.3.44) when applied to the plant (9.3.40) with A„(s) 7^ as follows: 

As in the ideal case considered in Section 6.5.1 for the same example but with 
Am(s) = 0, we start by writing the closed-loop plant equation as 

y=^^{-ey + A^{s)u) = ^— e'y + ry, u=-ey (9.3.45) 

Using the Swapping Lemma A.l and noting that em'^ = —0(f> + ry, we obtain from 
(9.3.45) that 



s -\- a. 



rn 



= em^ + e(P (9.3.46) 

Using the properties of the C2S norm ||(-)t||25, which for simplicity we denote by 
II • II, it follows from (9.3.46) that 

I|y||<lkm2|| + ||^— lU.II^Vll 

S + Qm 

for any < 6 < Sq. Because u = —6y and 6 e Ceo, it follows that 

||u||<c||y||<c||6m2|| + c||0Vll 

where c > is used to denote any finite constant. Therefore, the fictitious normal- 
izing signal 

m) = l + hf + ||2/f < 1 + c\\emY + cWhW" (9-3.47) 
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We can establish as in Chapter 6 that nif guarantees that m/rrif, (p/mf, rj/mf G C^c 
by using the properties of the C2S norm, which impUes that (9.3.47) can be written 
as 

m'j <1 + c||emm/|p + c\\6mf\\'^ < 1 + c||gm/||^ 

- A -2 

where g^ = e^w? + 9 or 



m 



t 
<l + c/ er^^*-^'^f{T)m){T)dT (9.3.48) 



Jo 
Applying the B-G Lemma III to (9.3.48), we obtain 

mj{t) < <t>{t,0) + 6 <t>{t,T)dT 
where 



$ 



(i,r) = e"*(*-^)e"/.'^'^'^''' 



Because the robust adaptive law guarantees that em, 6 G ^(Ag), we have g G '^(Aj 
and 

$(i,T)<e-(*-=^^)(*-") 



Hence, for 



cAl < 5 



<&(t, t) is bounded from above by a decaying to zero exponential, which implies 
that nif e £00 • Because of the normalizing properties of mf, we have (j),y,u £ Coo 
and all signals are bounded. The condition cA| < 5 implies that the multiplicative 
plant uncertainty A„(s) should satisfy 



A„(s) 



^ 5 
< - 

■2S„ C 

where c can be calculated by keeping track of all the constants. It can be shown 
that the constant c depends on || ^ 1 ^ \\ooS and the upper bound for |0(i)|. 

Because < (J < (5o is arbitrary, we can choose it to be equal to 60. The bound 
for supj \0{t)\ can be calculated from the Lyapunov-like function used to analyze 
the adaptive law. Such a bound, however, may be conservative. If, instead of the 
switching a, we use projection, then the bound for \0{t)\ is known a priori and the 
calculation of the constant c is easier. 

The effect of the unmodeled dynamics on the regulation error y is analyzed as 
follows: From (9.3.46) and ni,(j) ^ C^o, we have 

t+T ,.t+T ,.t+T ._2 

y'^dr < / e^m^dT + c 6 dr, Wt>0 
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for some constant c > and any T > 0. Then using the ni.s.s. property of em, 6, 
we have 

1 /■*+^ c 

^ J y^dT <cAl+- 

therefore y e ^(Al), i.e., the regulation error is of the order of the modeling error 
in m.s.s. 

The m.s.s. bound for y^ does not imply that at steady state, y^ is of the order of 
the modeling error characterized by A2. A phenomenon known as bursting, where 
y"^ assumes large values over short intervals of time, cannot be excluded by the 
m.s.s. bound. The phenomenon of bursting is discussed in further detail in Section 
9.4. 

The stability and robustness analysis for the MRAC scheme presented above 
is rather straightforward due to the simplicity of the plant. It cannot be directly 
extended to the general case without additional steps. A more elaborate but yet 
more systematic method that extends to the general case is presented below by the 
following steps: 

Stepl. Express the plant input u and output y in terms of the parameter error 
9. We have 

y = 9y + V 

u = {s-a)y-A^{s)u=-^^-^ey + r]u (9.3.49) 

S -J- dm 

where rju = — ^ , ^"^ A^(5)^. Using the C28 norm for some 8 G (0, 2am) we have 

\\y\\<c\\~ey\\ + M\, \\n\\<c\\~ey\\ + \\^^\\ 

and, therefore, the fictitious normalizing signal nif satisfies 

m} = l + ||«f + Ibf < 1 + c(||%f + hf + h„f ) (9.3.50) 



Step 2. Use the swapping lemmas and properties of the C2S norm to upper 
hound \\0y\\ with terms that are guaranteed by the adaptive law to have small in 
m.s.s. gains. We use the Swapping Lemma A. 2 given in Appendix A to write the 
identity 

9y = (1 - ^^)ey + -^~0y = -^{h + 'Oy) + -^h (9.3.51) 

where ao > is an arbitrary constant. Now from the equation for y in (9.3.49) we 
obtain 

ey= {s + a„i){T]- y) 
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which we substitute in the last term in (9.3.51) to obtain 

1 



Oy 



ao 



{9y + ey) + a,^-^^^{v-y) 



■ ao 



Therefore, by choosing S, ao to satisfy ao > a„i > | > 0, we obtain 
1 



ll%ll < 



ao 



{\\ey\\ + \\ey\\) + ao 



2 

S + Ur, 



ao 



Hence, 



where c : 



I s+a„ 

I s+ao II °° 



\m\ 



||NI< -(11^2/11 + IINI) + "oc(||ry|| + ||y||) 
ao 

s- Using (9.3.46), it follows that 



therefore. 



Il2/ll<lkm1|+c 



||NI<-(ll^'2/ll + ll^'y||) + "oc(||6m2|| 
ao 



WW 



(9.3.52) 



The gain of the first term in the right-hand side of (9.3.52) can be made small by 
choosing large ao- The m.s.s. gain of the second and third terms is guaranteed by 
the adaptive law to be of the order of the modeling error denoted by the bound 

A2, i.e., em, 6 G ^(Al). The last term has also a gain which is of the order of the 
modeling error. This implies that the gain of \\0y\\ is small provided A2 is small 
and ao is chosen to be large. 

Step 3. Use the B-G Lemma to establish boundedness. The normalizing prop- 
erties of rrif and 6 G C^o guarantee that y/mf,(j)/mf,m/'mf G C^c- Because 

||y||<|a|||y|| + ||A„(s)|U,||u|| + ||u|| 

it follows that Hyll/jri/ G >Coo- Due to the fact that Am(s) is proper and analytic in 
Re[s] > —5o/2, II Am(s)||oo(5 is a finite number provided < 5 < Sq. Furthermore, 
||?7||/mj < Aoo where 

Amis) 



A, 



(9.3.53) 



00 (5 



and, therefore, (9.3.52) may be written in the form 

\\0y\\ < —iWOmfW + mf) + aoc(||emm/|| + \\6mf\\ + AooTUf) (9.3.54) 

ao 

Using (9.3.54) and H^yll/n^^ < cAqo, II^uII/ti/ < cAqo in (9.3.50), we obtain 



mf<l+c 



an 



alAl^)mj + c\\gmf\\' 
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where g^ 



\0\' 



+ a^\em\'^ + al\0\'^ and ao > 1- For c ( -^ + OqA^ 



\< 



< 1, we have 



nif < c + c||(/?77,y|| 



c e 



-S(t-T)~2 



g {T)mf{T)di 



Applying the B-G Lemma III, we obtain 



rris < ce 



St^cjyg-(r)dT ^^^ /'*g-<5(t-s)gcj;;g-(r)dr 



ds 



Because 0, em G ^(Al), it follows that 



-2 



Hence, for 



we have 



where a ■ 



g {T)dT < cA 



cAi 



+ tto (t - s) + c 



<6 



-St c£~g^(T)dT ^ at 



(9.3.55) 



■cAi 



iQ I which implies that nif is bounded. The boundedness 

of nif implies that all the other signals are bounded too. The constant 6 in (9.3.55) 
may be replaced by Sq since no restriction on 6 is imposed except that S G (0,(5o]. 
The constant c > may be determined by following the calculations in each of the 
steps and is left as an exercise for the reader. 

Step 4. Obtain a bound for the regulation error y. The regulation error, i.e., 
y, is expressed in terms of signals that are guaranteed by the adaptive law to be of 
the order of the modeling error in m.s.s. This is achieved by using the Swapping 
Lemma A.l for the error equation (9.3.45) and the equation em? = —9<f)+r] to obtain 
(9.3.46), which as shown before implies that y G S{A2). That is, the regulation 
error is of the order of the modeling error in m.s.s. 

The conditions that Am(s) has to satisfy for robust stability are summarized 
as follows: 



1 



alA 



< 1, cAi 



1 



ar 



< 6o 



where 



A, 



Amis) 



ooSq 



Ao 



A„(s) 



2So 



The constant (5o > is such that Am{s) is analytic in Re[s] > —Sq/2 and c denotes 
finite constants that can be calculated. The constant ao > max{l, 5q/2} is arbitrary 
and can be chosen to satisfy the above inequalities for small A2, Aqq. 
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Let us now simulate the above robust MRAC scheme summarized by the equa- 
tions 

u = —9y 

= 'ye<f) - as^O, € = 5— 

1 1 

-2/, 



S -r drii ^ ~r ^m 

m = 1 + TOs, rhs = —S^mg + u + y , mg{{)) = 
where Ug is the switching <t, and applied to the plant 

y = (1 + A„(s))m 

s — a 

where for simulation purposes we assume that a = 1 and Am(s) = — . /;"' with 
/i > 0. It is clear that for /i > the plant is nonminimum phase. Figure 9.2 
shows the response of y{i) for different values of ^ that characterize the size of 
the perturbation Am(s). For small /i, we have boundedness and good regulation 
performance. As /i increases, stability deteriorates and for /i = 0.35 the plant 
becomes unstable. \/ 



General Case 

Let us now consider the SISO plant given by 

yp = Go(s)(l + A„(s))(np + d„) (9.3.56) 

where 

Go{s) = k,^ (9.3.57) 

is the transfer function of the modeled part of the plant. The high frequency 
gain kp and the polynomials Zp(s), Rp{s) satisfy assumptions PI to P4 given 
in Section 6.3 and the overall transfer function of the plant is strictly proper. 
The multiplicative uncertainty Amis) satisfies the following assumptions: 

51. Amis) is analytic in Re[s] > —5o/2 for some known Sq > 0. 

52. There exists a strictly proper transfer function Wis) analytic in Re[,s] > 

— 5o/2 and such that VF(s)Am(s) is strictly proper. 



H = 0.23 
|j. = 0.2 
ji = 0.1 
ji = 0.05 
|j. = 0.0 



Figure 9.2 Simulation results of the MRAC scheme of Example 9.3.2 for 
different /x. 

Assumptions SI and S2 imply that Aoo,A2 defined as 

A^ ^ \\W{s)Am{s)\\^So ' ^2 = \\W{s)A^{s)\\,,^ 

are finite constants. We should note that the strict properness of the overall 
plant transfer function and of Go(s) imply that Go(s)Am(s) is a strictly 
proper transfer function. 

The control objective is to choose Up and specify the bounds for Aqo, A2 
so that all signals in the closed-loop plant are bounded and the output yp 
tracks, as close as possible, the output of the reference model ym given by 

Vm = Wm[s)r = km ^ , . r 

Rm{s) 

for any bounded reference signal r(t). The transfer function Wmis) of the 
reference model satisfies assumptions Ml and M2 given in Section 6.3. 

The design of the control input Up is based on the plant model with 
^mis) = and du = 0. The control objective, however, has to be achieved 
for the plant with Am(s) / and du / 0. 
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We start with the control law developed in Section 6.5.3 for the plant 
model with Am(s) = 0, d^ = 0, i.e., 

Up = e^uj (9.3.58) 

where 9 = [Oj ,9^ ,03,co\ ,uj = [ujj jtoj iVp^''"] • The parameter vector 9 is 
to be generated on-line by an adaptive law. The signal vectors uji,uJ2 are 
generated, as in Section 6.5.3, by filtering the plant input Up and output jjp. 
The control law (9.3.58) will be robust with respect to the plant uncertainties 
Am{s),du if we use robust adaptive laws from Chapter 8, instead of the 
adaptive laws used in Section 6.5.3, to update the controller parameters. 

The derivation of the robust adaptive laws is achieved by first developing 
the appropriate parametric models for the desired controller parameter vec- 
tor 9* and then choosing the appropriate robust adaptive law by employing 
the results of Chapter 8 as follows: 

We write the plant in the form 

Rpyp = kpZp(l + Am)iup + du) (9.3.59) 

and then use the matching equation 

(A - 9fa)Rp - kp{9fa + A9l)Zp = ZpL^Rm (9.3.60) 

where a = a„_2(s) = [s"~^, •••,«, 1]^, (developed in Section 6.3 and given 
by Equation (6.3.12)) satisfied by the desired parameter vector 

9* = [9f,9f,9lcl]' 

to eliminate the unknown polynomials Rp{s), Zp(s) from the plant equation 
(9.3.59). From (9.3.59) we have 

(A - 9fa)Rpyp = (A - 9fa)kpZp{l + A„)(^ip + d^) 

which together with (9.3.60) imply that 

Zp{kp{9fa + A91) + AoRm)yp = (A - 9fa)kpZp{l + A„)(up + d„) 

Filtering each side with the stable filter j^ and rearranging the terms, we 
obtain 

'2 T + ^3 ) J/p + ~^ Vp ~ kpUp — kp9i -jrUp 



+ kp {i\rn{Up + du) + du) 
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or 



-rCt -rCX 

K TUp + 02 -Typ + 0*^p-Up 



Because Cq = -f^ it follows that 



■— VF^'ypH -^ (A„(up + du) + du) 



Wm ( ^1 ^Hp + 0*2^ -Vp + 0|yp - n, 



-c*oyp + I4^m(s)7?o (9.3.61) 



where 



% = T {^m{Up + du) + du) 

is the modeling error term due to the unknown A^, du- 
As in the ideal case, (9.3.61) can be written as 



Wm{s)up = e* 4>p-r] 



(9.3.62) 



where 



r = [ef,ef,eicl]'^, <t>p = [Wm^Up,Wm^yp,W^yp,yp\ 



1] = Wmis)r]o = -^ Wmis)[(Amiup + du) + du)] 

Equation (9.3.62) is in the form of the linear parametric model (8.5.6) con- 
sidered in Chapter 8. 

Another convenient representation of (9.3.61) is obtained by adding the 
term c^ym = CQWmr on each side of (9.3.61) to obtain 

WmiOl^Y'^P + ^2^ I^VP + ^t^Vp + ^0*^ ~ ^p) = -4>yp + 4>ym + VFm(s)?70 



A 



A' 



or 



leading to 

where ei = yp - ym, 



WmiO*^UJ - Up) = -CqEi + Wmis)r]o 
ei = Wmis)p*{up - e*'^uj + rjo) 



(9.3.63) 



P 






UptIIpi 
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which is in the form of the bihnear parametric model (8.5.15) considered in 
Chapter 8. 

Using (9.3.62) or (9.3.63), a wide class of robust MRAC schemes can be 
developed by simply picking up a robust adaptive law based on (9.3.62) or 
(9.3.63) from Chapter 8 and use it to update 6(t) in the control law (9.3.58). 
Table 9.1 gives a summary of MRAC schemes whose robust adaptive laws 
are based on (9.3.62) or (9.3.63) and are presented in Tables 9.2 to 9.4. 

The robust adaptive laws of Tables 9.2 to 9.4 are based on the SPR- 
Lyapunov design approach and the gradient method with an instantaneous 
cost. Additional MRAC schemes may be constructed in exactly the same 
way using the least-squares method or the gradient method with an integral 
cost. The properties of this additional class of MRAC schemes are very 
similar to those presented in Tables 9.2 to 9.4 and can be established using 
exactly the same tools and procedure. 

The following theorem summarizes the stability properties of the MRAC 
scheme of Table 9.1 with robust adaptive laws given in Tables 9.2 to 9.4. 

Theorem 9.3.2 Consider the MRAC schemes of Table 9.1 designed for the 
plant model yp = Go{s)up but applied to the plant (9.3.56) with nonzero plant 
uncertainties Am{s) and du. If 



at 



+ «2fcAL <1, c(^ + af){fo + Ah< 



a 



(9.3.64) 



where 



Ai = Ao2 and k = n* + 1 for the adaptive law of Table 9.2 
Aj = A2 and k = n* for the adaptive laws of Tables 9.3, 9.4 

Aoo = \\W{s)Am{s)\\oo5o 



A 



02 



^(^)-^^^"(-^L-(.)^A„(.) 



A, 



A{s) 
A{s) - efa{s 



A{s) 



s + ho 

-Wmis)Amis 



25n 



2<5n 



5 e (0,(^0) is such that Gq (s) is analytic in Re[s] > —5/2 
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• Oo > niaxjl, (5o/2} is an arbitrary constant 

• Hq > So/ 2 is an arbitrary constant 

• c > denotes finite constants that can be calculated and 

(c-) /o = o" m the case of fixed a -modification 

(b) /o = vq in the case of e-modification 

(c) /o = 90 in the case of dead zone modification 

(d) fo = Oin the case of switching cr -modification and projection 

Then all the signals in the closed-loop plant are bounded and the tracking 
error ei satisfies 



I eldr<ciA^ + dl + fo) + ^, Vi > 



and for any T > 0, where do is an upper bound for \du\ and A^ = l/ag + 
A^ + A2 + Aq2 for the scheme of Table 9.1 with the adaptive law given in 
Table 9.2 and A^ = A2 for the scheme of Table 9.1 with adaptive laws given 
in Tables 9.3, 9.4. 

If, in addition, the reference signal r is dominantly rich of order 2n 
and Zp, Rp are coprime, then the parameter error 9 and tracking error ei 
converge to the residual set 

s = {ee Te^", eien\\e\ + \ei\ < c(/o + a + do) } 

where /o,A are as defined above. The convergence to the residual set S is 
exponential in the case of the scheme of Table 9.1 with the adaptive law given 
in Table 9.4. 

Outline of Proof The main tools and Lemmas as well as the steps for the 
proof of Theorem 9.3.2 are very similar to those in the proof of Theorem 6.5.1 
for the ideal case. A summary of the main steps of the proof are given below. 
The details are presented in Section 9.8. 

Step 1. Express the plant input and output in terms of the parame- 
ter error term 0^ uj. In the presence of unmodeled dynamics and bounded 
disturbances, the closed-loop MRAC scheme can be represented by the block 
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Table 9.1 Robust MRAC Schemes 



Actual plant 


yp = kp§l^il + A„,{.s))iup + d^) 


Plant model 


7 Zp{s) 
Up - I^PR^(s)'^p 


Reference 
model 


Vra = Wm{s)r = km^^r 


Control law 


ioi = Fuji + QUp 
L02 = Fu2 + gyp 
Up = 9 oj 
e=[e'l,9l,e:,,c^]^,oj=[u:J,ujl,yp,r]^ 


Adaptive law 


Any robust adaptive law from Tables 9.2 to 9.4 


Assumptions 


(i) Plant model and reference model satisfy assump- 
tions PI to P4, and Ml and M2 given in Section 
6.3.1 for the ideal case; (ii) Am(s) is analytic in 
Re[s] > —5q/2 for some known 5q > 0; (iii) overall 
plant transfer function is strictly proper 


Design 
variables 


Wm,W~^ and ^, where A(s) = det(s/ - F) are 
designed to be analytic in Re[s\ > —5q/2 



diagram shown in Figure 9.3. From Figure 9.3 and the matching equation 
(6.3.11), we can derive 

1 .T 



Vp 



Wm[r + 



+ Vy 



1 ;Tn 



Go'Wrnir+-e'^Lo]+r]u 



(9.3.65) 



680 



CHAPTER 9. ROBUST ADAPTIVE CONTROL SCHEMES 



Table 9.2 Robust adaptive laws based on the SPR-Lyapunov 
approach and bilinear model (9.3.63) 



Parametric model 
(9.3.63) 


ei = Wmis)p*{up - 6*^uj + ??o) 


Filtered 
parametric model 


e/ = Wm{s)L{s)p*{uf - e*^<P + rif) 

r]f = Lo{s)r]o, uj = Lo{s)up, (p = Lq{s)uj 

Lo{s) = L-\s)^^,ho>5o/2 
L{s) is chosen so that WmL is proper and SPR 
L(s),L~^(s) are analytic in Re(s) > — ^ 


Normalized 
estimation error 


e = e/ - e/ - WmLenI, if = WmLp{uf - 6'^ (p) 
n1 = ms,ms = -doms + ^ + yl,ms{0) = 


Robust adaptive 
laws with 

(a) Leakage 

(b) Dead zone 

(c) Projection 


9 = re(^sgn(p*) — wiT6, p = ■jeS, — W2"yp 

where wi,W2 are as defined in Table 8.1 and P = 
r^ >0,7>0 

e = TcP{e + g)sgn{p*),p = j^{e + g) 
where g is as defined in Table 8.7 

^ = Pr[r(/.esgn(p*)],p = Pr[7ee] 

where the operator Pr[-] is as defined in Table 8.6 


Properties 


2 

(i) e,ens,0,p e C^,{ii)e,ens,0, p G 5(/o + ^), 
where m^ = 1 + n^ and /o is a design parameter, 
depending on the choice of wi,W2 and g in (a), (b), 
and /o = for (c) 
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Table 9.3 Robust adaptive laws based on the gradient method 
and bilinear model (9.3.63) 



Parametric model 
(9.3.63) 


VO = A [^m{Up + du) + du] 


Parametric model 
rewritten 


ei = p*(uf - 9*'^ (j) + r]),Uf = WmUp, 4> = Wmto 

V = ~A '^Wm[^m{Up + du) + d«] 


Normalized 
estimation error 


nl = ms,ms = -SqitIs + u^ + yp, 771^(0) = 


Robust 
adaptive laws 


Same expressions as in Table 9.2 but with 
e, (/), ^, Uf as given above 


Properties 


(i) e, tris, 9, p, 6, p e C^; (ii) e, en^, 9, 

2 

yO e 5(/o + ^), where /q is as defined in Table 
9.2 



where 



Vy 



A — C* D* 

—-^Wm[^m{Up + du) + du], riu = -j^Wm[^m{Up + du) + du] 



cSA 



CoA 



where Cl{s) = 6i a{s), DJ = ^2 "(-5) + ^3A(s). Using the properties of the 
C2S norm ||(-)t||25, which for simplicity we denote as ||(-)||, and the stability 
of Wm, Gq , it follows that there exists 5 e (0, ^o] such that 

llypll < c + cll^^wll + 



< c + c\\9 uj\\ + \\riu\ 



The constant 5 > is such that Gq (s) is analytic in Re[s] > —5/2. There- 

es 

(9.3.66) 



fore, the fictitious normalizing signal m^ = 1 + ||np|p + ||yp|p satisfies 



mj < c + c\\9'^io\\'^ + c 



2 II ii2 

+ c||??„|| 
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Table 9.4 Robust adaptive laws based on the linear model 

(9.3.62) 



Parametric 
model 


Z = WmUp, (pp = [Wm^Up, Wm^Vp, WmVp, Vp]'^ 


Normalized 

estimation 

error 


m,2 = 1 + nis, rhs = -Sonis + u^ + y^, ms(0) = 


Constraint 


B{9) = Cq — CQsgn{-j^) < for some Cg > 
satisfying < Cg < Cg 


Projection 
operator 


Pr[/]=< 
VB = 


7 if |co| > Co 

or if |co| = Co and f^VB < 

./-[v^TrvB/ otherwise 

-[0,...,0,l]'^sgn{kp/km) 
>0 


Robust 
adaptive law 


e = Pi[f], |co(0)|>co 


(a) Leakage 

(b) Dead zone 

(c) Projection 


/ = 
/ = 

e=< 

wh 
tior 


= Vt(j)p — wT6, w as given in Table 8.1 

= T4>p{e + g),g as given in Table 8.4 

•Pr[re</)p] if 1^1 < Mo 

or \e\=Mo and {Pr[Te(f)p])^e<0 
,(^-pfJ)Pr[re</>p] otherwise 
are Mq > \e*\, \e{0)\ < Mq and Pr[-] is the projec- 
1 operator defined above 


Properties 


(i) e, ens, 0, 9 G C^- (ii) e, en„ 6 G 5(/o + ^), where 
/o is as defined in Table 9.2 
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LO ryi = A„i{up + rf„) + d„ 




Figure 9.3 The closed-loop MRAC scheme in the presence of unniodeled 
dynamics and bounded disturbances. 



Step 2. Use the swapping lemmas and properties of the C2S norm to 
bound \\6'^Lo\\ from above with terms that are guaranteed by the robust adap- 
tive laws to have small in m.s.s. gains. In this step we use the Swapping 
Lemma A.l and A. 2 and the properties of the C2S-i^o'noa to obtain the ex- 
pression 

3T^,n / „„„_ ji , „^ 1 , „.fcA ^™_,„^_ (9.3.67) 



1^ w|| < cll^m/ II + c( h aQAoo)w,f + cdo 



d?, 



where oq > max{l,5o/2} is arbitrary and g E 5(/o + A^ + -^) with Aj 
^02) A; = n* + 1 in the case of the adaptive law of Table 9.2, Aj = A2, k = n* 
in the case of the adaptive laws of Tables 9.3 and 9.4, and do is an upper 
bound for \du\. 

Step 3. Use the B-G Lemma to establish boundedness. Using (9.3.67) 
in (9.3.66) we obtain 



roj <c + cll^m/lp + c I — 2 



+ af^l, ] m) + cdl 



We choose ao large enough so that for small A^ 

1 



,2k \ 2 



an 



+ <^to 1 < 1 
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We then have m'i < c + c||gfm/|p for some constants c > 0, which iniphes 

that 

ft 

m)<c+c e-^^^-^^g'^{T)m){T)dT 
Applying the B-G Lemma III, we obtain 

Because 

r g\r)dT < c{fo + A^){t -s) + cf ^dr + c 
J s J s n^ 

Vt > s > 0, it follows that for c(/o + Af) < S/2 we have 

2 ^ -It c (''(dl/m?)dT I r f -l(t-s) c ^'^ (dl/m?)dT i 

rrii < ce 2 e Jo ^ 0/ ^ + co e ^^ 'e Js^ "' ' ds 



The boundedness of rrif follows directly if we establish that c ^2%) < (5/2, 
Vt > 0. This condition is satisfied if we design the signal n^ as n^ = /3o + ms 
where /3o is a constant chosen large enough to guarantee c ^2°u\ < Cjf- < 
(5/2, Vt > 0. This approach guarantees that the normalizing signal m^ = 
1 + n^ is much larger than the level of the disturbance all the time. Such a 
large normalizing signal may slow down the speed of adaptation and, in fact, 
improve robustness. It may, however, have an adverse effect on transient 
performance. 

The boundedness of all signals can be established, without having to 
modify n^, by using the properties of the C25 norm over an arbitrary interval 
of time. Considering the arbitrary interval [ti,t) for any ii > we can 
establish by following a similar procedure as in Steps 1 and 2 the inequality 

+c5 / e-2(*-'*)e -'^ "'M" ds,yt > h > (9.3.68) 
Jti 

We assume that m?{t) goes unbounded. Then for any given large number 
a > there exists constants ^2 > ^1 > such that Tm?iti) = a, m?{t2) > 
/i(a), where /i(a) is any static function satisfying /i(a) > a. Using the fact 
that m^ cannot grow or decay faster than an exponential, we can choose /i 
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properly so that m?{t) > a Vt G [ti, ^2] for some ti> a where t2 — ti > a. 
Choosing a large enough so that (1^/61 < 5/2, it follows from (9.3.68) that 

m^{t2) <c{l + a)e-'2^e< + c 

We can now choose a large enough so that m?'{t2) < a which contradicts 
with the hypothesis that m?{t2) > ot and therefore m £ £oo- Because m 
bounds Up,yp,uj from above, we conclude that all signals are bounded. 

Step 4. Establish bounds for the tracking error ei. Bounds for ei in 
m.s.s. are established by relating ei with the signals that are guaranteed by 
the adaptive law to be of the order of the modeling error in m.s.s. 

Step 5. Establish convergence of estimated parameter and tracking error 
to residual sets. Parameter convergence is established by expressing the pa- 
rameter and tracking error equations as a linear system whose homogeneous 
part is e.s. and whose input is bounded. 

The details of the algebra and calculations involved in Steps 1 to 5 are 
presented in Section 9.8. 

Remark 9.3.2 Effects of initial conditions. The results of Theorem 9.3.2 
are established using a transfer function representation for the plant. 
Because the transfer function is defined for zero initial conditions the 
results of Theorem 9.3.2 are valid provided the initial conditions of 
the state space plant representation are equal to zero. For nonzero 
initial conditions the same steps as in the proof of Theorem 9.3.2 can 
be followed to establish that 

mjit) <c + cpo + cpoe-^^ + c e'^^^'^'^ g'^{T)m){T)dT 

where po > Q depends on the initial conditions. Applying the B-G 
Lemma III, we obtain 



m%t) < (c + cpo)e-'^*e'=i'o^'W'^^ + 5(c + cpo) / e-^^'-^h'-C'"^'^'''dT 



/o 

where g £ 5(/o + A? + ^0/771^) and fo,A.i are as defined in Theo- 
rem 9.3.2. Therefore the robustness bounds, obtained for zero initial 
conditions, will not be affected by the non-zero initial conditions. The 
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bounds for m/ and tracking error ei, however, will be affected by the 
size of the initial conditions. 

Remark 9.3.3 Robustness without dynamic normalization. The results of 
Theorem 9.3.2 are based on the use of a dynamic normalizing signal 
rUs = nl so that m = \/l + n^ bounds both the signal vector (f) ^-nd 
modeling error term rj from above. The question is whether the signal 
m-s is necessary for the results of Theorem 9.3.2 to hold. In [168, 240], 
it was shown that if m is chosen as m^ = 1 + (f) 4>, i.e., the same 
normalization used in the ideal case, then the projection modification 
alone is sufficient to obtain the same qualitative results as those of 
Theorem 9.3.2. The proof of these results is based on arguments over 
intervals of time, an approach that was also used in some of the original 
results on robustness with respect to bounded disturbances [48]. The 
extension of these results to modifications other than projection is not 
yet clear. 

Remark 9.3.4 Calculation of robustness bounds. The calculation of the 
constants c, (5, Aj,Aoo is tedious but possible as shown in [221, 227]. 
These constants depend on the properties of various transfer func- 
tions, namely their H^^,H2S bounds and stability margins, and on 
the bounds for the estimated parameters. The bounds for the esti- 
mated parameters can be calculated from the Lyapunov-like functions 
which are used to analyze the adaptive laws. In the case of projection, 
the bounds for the estimated parameters are known a priori. Because 
the constants c, Aj,Aoo,^ depend on unknown transfer functions and 
parameters such as Go{s), Gq (s), 6* , the conditions for robust stabil- 
ity are quite difficult to check for a given plant. The importance of the 
robustness bounds is therefore more qualitative than quantitative, and 
this is one of the reasons we did not explicitly specify every constant 
in the expression of the bounds. 

Remark 9.3.5 Existence and uniqueness of solutions. Equations (9.3.65) 
together with the adaptive laws for generating 9 = 9 + 9* used to 
establish the results of Theorem 9.3.2 are nonlinear time varying equa- 
tions. The proof of Theorem 9.3.2 is based on the implicit assumption 
that these equations have a unique solution Vt e [0,oo). Without 
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this assumption, most of the stabihty arguments used in the proof of 
Theorem 9.3.2 are not vahd. The problem of existence and unique- 
ness of solutions for a class of nonlinear equations, including those of 
Theorem 9.3.2 has been addressed in [191]. It is shown that the sta- 
bility properties of a wide class of adaptive schemes do possess unique 
solutions provided the adaptive law contains no discontinuous modifi- 
cations, such as switching a and dead zone with discontinuities. An 
exception is the projection which makes the adaptive law discontinuous 
but does not aifect the existence and uniqueness of solutions. 

The condition for robust stability given by (9.3.64) also indicates that the 
design parameter /o has to satisfy certain bounds. In the case of switching a 
and projection, /o = 0, and therefore (9.3.64) doesnot impose any restriction 
on the design parameters of these modifications. For modifications, such as 
the e-modification, fixed a, and dead zone, the design parameters have to 
be chosen small enough to satisfy (9.3.64). Because (9.3.64) depends on 
unknown constants, the design of /o can only be achieved by trial and error. 

9.3.4 Robust Indirect MRAC 

The indirect MRAC schemes developed and analyzed in Chapter 6 suffer 
from the same nonrobust problems the direct schemes do. Their robustifica- 
tion is achieved by using, as in the case of direct MRAC, the robust adaptive 
laws developed in Chapter 8 for on-line parameter estimation. 

In the case of indirect MRAC with unnormalized adaptive laws, robusti- 
fication leads to semiglobal stability in the presence of unmodeled high fre- 
quency dynamics. The analysis is the same as in the case of direct MRAC 
with unnormalized adaptive laws and is left as an exercise for the reader. 
The failure to establish global results in the case of MRAC with robust but 
unnormalized adaptive laws is due to the lack of an appropriate normaliz- 
ing signal that could be used to bound from above the effect of dynamic 
uncertainties. 

In the case of indirect MRAC with normalized adaptive laws, global 
stability is possible in the presence of a wide class of unmodeled dynamics 
by using robust adaptive laws with dynamic normalization as has been done 
in the case of direct MRAC in Section 9.3.3. 
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We illustrate the robustification of an indirect MRAC with normalized 
adaptive laws using the following example: 

Example 9.3.3 Consider the MRAC problem for the following plant; 

yp= (l + A„(s))Mp (9.3.69) 

s — a 

where A^ is a proper transfer function and analytic in Re[s] > —Sq/2 for some 
known Sq > 0, and a and b are unknown constants. The reference model is given by 

Vm = — ; r, a„ > 

S + Qm 

If we assume Am{s) = 0, the following simple indirect MRAC scheme can be used 
to meet the control objective: 

Up = -k{t)yp + l{t)r (9.3.70) 



7ie(/)i, if |6| > 6o or 
a = 72e02, h= \ if 1^1 = ^o and e0isgn(6) > (9.3.71) 

otherwise 

m^ = l + </)i + 02, 01 = — —- Mp; 02 = — — ryp 

S -\- A S -\- A 

Z — Z S •^ 

e= — , z= — — -2/p, z = b<t>i + a<t>2 

171 S + A 

6(0) > &o, bo is a known lower bound for \b\ and A > is a design constant. When 
(9.3.70) and (9.3.71) are applied to the plant (9.3.69), the ideal properties, such as 
stability and asymptotic tracking, can no longer be guaranteed when Am{s) ^ 0. 
As in the case of the direct MRAC, the boundedness of the signals can be lost due 
to the presence of unmodeled dynamics. 

The indirect MRAC scheme described by (9.3.70) and (9.3.71) can be made 
robust by using the techniques developed in Chapter 8. For example, instead of the 
adaptive law (9.3.71), we use the robust adaptive law 

a = 72602 - CTsJia 

71601 - jiagb, if |6| > bo or 

if |6| = 6o and (e0i - asb)sgn{b) > (9.3.72) 
otherwise 



where 
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where 



m" 



1 



-Up, <p2 



z = 601 + a02 
1 



-Vp, 



z ■■ 



s + X 

.2 I „,2 



Vp 



m^ = l + nl, nl = rus, rfis = -Sonis + u^ + Vp, ms(0) = 

The design constants A and a„i are chosen as A > (5o/2,am > (5o/2, cr^ is the 
switching fi- modification as defined in Chapter 8, 6o is a lower bound satisfying 
< bo < \b\. The above robust adaptive law is developed using the parametric 
model 

z = e*^(j) + ri 

for the plant (9.3.69) where 6* = [6, a]^, 



1 



1 



Up, 



s + X ^'s+ A 



Vp 



wi,<P2\ , v= — r^r"p 

S -\- A 



As we have shown in Chapter 8, the adaptive law (9.3.72) guarantees that 
(i) e, em, a, 6, a, 6 G £00 



(ii) e, eris, a, 6 G iS(A|), where A2 



I^HiMll . 



V 



Let us now apply the MRAC scheme given by the control law (9.3.70) 
and robust adaptive law (9.3.72) to the plant (9.3.69). 

Theorem 9.3.3 The closed-loop indirect MRAC scheme given by (9.3.69), 
(9.3.70), and (9.3.72) has the following properties: If r,r G £00 o-nd the 
plant uncertainty Am(s) satisfies the inequalities 



Oin 



+ cA^ + ca^Al<l, cA^< 



where 

Aoo 



\Wm{s)^ra{s)\\oo&„, A2 



Am(s) 



8 + \ 



25o 



,A> 



A™(s) 



S + X 



00 So 



where ao > <^o is an arbitrary constant and c > denotes any finite constant, 
then all signals are bounded and the tracking error ei satisfies 

ft+T 

efdr < cAI + c 



I 



for all t > and any T > 0. 
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Proof As in the direct case, the proof may be completed by using the following 
steps: 

Step 1. Express yp, Up in terms of the plant parameter error a = a— a, b = b—b. 
First we write the control law as 

Up = —kyp + Ir = —k*yp + Vr — kyp + Ir (9.3.73) 

where k* = {am + a)/6, I* = bm/b. Because k = a/b — kb/b and I = —Ib/b, (9.3.73) 
can also be written as 

Up = —k*yp + rr — -{ayp + bup) (9.3.74) 

by using the identity —kyp -\- Ir = Up. Using (9.3.74) in (9.3.69), we obtain 

yp = Wm{s) (r - ^e^ujp + ^Am{s)upj (9.3.75) 

where Wp = [up,yp]^ and 6 = [b,d]^ . 

Equation (9.3.74) may be also written in the compact form 

Up = —k*yp + l*r — -9 ujp (9.3.76) 

Using the properties of the C25 norm which for simplicity we denote by ||(-)||, we 
have 

WVpW < c+c||Ftjp|| + — ||W„(s)A,„(s)||oo5||wp|| 
\\up\\ < c + c||yp||+c||^^Wp|| 
which imply that 



llupll, WVpW < c+c\\e'^ujp\\ +cAoo||Wp 



A 



where Aqo = || W^m('S)Am(s)||oo5 for some 5 G (0,(5o]. The fictitious normalizing 
signal mi = 1 + ||Mp|P + WVpW^ satisfies 

m)<c+c\\¥ujpf + cl^l^m) (9.3.77) 

Step 2. Obtain an upper bound for \\9^ ujp\\ in terms of signals that are guar- 
anteed by the adaptive law to have small in m.s.s. gains. We use the Swapping 
Lemma A. 2 to express 0^ ujp as 

■^ Wn = I 1 \ uj„-\ d Ulp 

s + aoj s + ao 

^ ''^up + ¥^p) + ^^^^±A -^Fujp (9.3.78) 



s + ao s + ao s + \ 



9.3. ROBUST MRAC 691 

where ao > Sq is arbitrary. From Swapping Lemma A.l, we have 

-^e'^LOp = F4> - -^4>'^e (9.3.79) 

s + \ s + X 

where = -^^ujp. From the estimation error equation 

em = z — z = —6 (p + rj 
we have 



-em + rj 



and, therefore, (9.3.79) may be expressed as 



^T^^ = _£^2_^^ ^T(j (9.3.80) 



.s + A" P ^ ' s + \ 

Substituting (9.3.80) in (9.3.78), we obtain 

e'^up = -^—[6'^ Up + Ft^J + ^^ii±^ f-em^ + r, - -^^'^e] (9.3.81) 
s + ao s + Q!o\ s + A / 

The signal nif bounds from above \<jjp\, ||tL'p||,m, -jTrj^i^p- This can be shown as 
follows: Because the adaptive law guarantees that 9 G C^c, it follows from (9.3.75) 
that 

\yp{t)\ <c+c||a)p||+cAi||wp|| < c + c\\up\\ + c\\yp\\ 

where Ai = || Wm(s)A„i(s)||25, and, therefore, yp/nif G Ceo- From Up = —kyp + Ir 
and k,l G Ceo, it follows that Up/nif G Ceo and, therefore, LOp/nif G Ceo- Using 
(9.3.75) we have 

hpW < \\sWm{s)\\ooS{c+c\\ujp\\) + c\\sWm{s)A^{s)\\oos\\Up\\ 

< c + c\\LUp\\ + c\\up\\ < c + cnif 

Therefore, ||yp||/?Ti^ G Coo- Now tip = —kyp + hyp -\- Ir -\- If. Because fc, I G Ceo and 
by assumption r^f & Ceo, it follows from \yp\/'nif G Ceo and ||2/p||/m,/ G Ceo that 
\\up\\/mf G £00- From \\ujp\\ < \\up\\ + \\yp\\, it follows that ||cjj,||/m/ G £00- The 
boundedness of m/mf, (j)/mf follows in a similar manner by using the properties of 
the C2S norm. 

Using the normalizing properties of nif and the properties of the C2S norm, we 
obtain from (9.3.81) the following inequality: 

WO'^^pW < —iW'OmfW + ruf) + ao{\\emmf\\ + A^ruf + \\dmf\\) (9.3.82) 

where for the ||?7|| term we used the inequality 

M < AaIImpII < cAxmf 
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where A\ = \\ J";^ ||oo<5- The "smallness" of ||0^Ljjp|| follows from 6, em G ^(Al) 
and by choosing ag large. 

Step 3. Use the B-G Lemma to establish houndedness. Using (9.3.82) in 
(9.3.77), we obtain 

m^ < c + c||gm/|p H ^rn^j + capA^mj + cA^m^ 

ag 

where g"^ = (^ + a§)|^P + ag|emp, i.e., g G 5(A2). Therefore, for 

c 



a, 



cat^i + cA^ < 1 







we have 

TOj < c+ c||gm/||^ 

or 

m}{t) <c+c f e~^^'~^^f{T)m){T)dT 
Jo 
Applying the B-G Lemma III, we obtain 

m}{t) < ce-**e^/o'^'(^)'^^ + c<5 f e~'^'~'^e' ^l'^^^^''^ ds 

Jo 

Because g G ^(Al), i.e., / g'^{T)dT < cA^t — s) + c, it follows that for cA^ < S, 
rni G Ccc which implies that all signals are bounded. 

Step 4. Error bounds for the tracking error. Using (9.3.75), the tracking error 
ei = Vp - Vm is given by 

1 



1 XT s + \ s + X 
ei = — - — e Wp+— 7? = -— 

Using (9.3.80), we have 



-— gi^CJp - T] 



ei = — — I em^ + r(t>'^0] (9.3.83) 

s + a™ V s + X^ J 

Because em,0 G iS(A|) and (j),m a >Coo, it follows from (9.3.83) and Corollary 3.3.3 
that ei G 5(A|), i.e., 

j-t+T 

I eldr < cAIT + c 
Vt > and any T > 0. □ 

The extension of this example to the general case follows from the mate- 
rial presented in Section 9.3.3 for the direct case and that in Chapter 6 for 
indirect MRAC and is left as an exercise for the reader. 
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9.4 Performance Improvement of MRAC 

In Chapter 6 we have estabhshed that under certain assumptions on the 
plant and reference model, we can design MRAC schemes that guarantee 
signal boundedness and asymptotic convergence of the tracking error to 
zero. These results, however, provide little information about the rate of 
convergence and the behavior of the tracking error during the initial stages 
of adaptation. Of course if the reference signal is sufficiently rich we have 
exponential convergence and therefore more information about the asymp- 
totic and transient behavior of the scheme can be inferred. Because in most 
situations we are not able to use sufficiently rich reference inputs without 
violating the tracking objective, the transient and asymptotic properties of 
the MRAC schemes in the absence of rich signals are very crucial. 

The robustness modifications, introduced in Chapter 8 and used in the 
previous sections for robustness improvement of MRAC, provide no guaran- 
tees of transient and asymptotic performance improvement. For example, 
in the absence of dominantly rich input signals, the robust MRAC schemes 
with normalized adaptive laws guarantee signal boundedness for any finite 
initial conditions, and a tracking error that is of the order of the modeling 
error in m.s.s. Because smallness in m.s.s. does not imply smallness point- 
wise in time, the possibility of having tracking errors that are much larger 
than the order of the modeling error over short time intervals at steady state 
cannot be excluded. A phenomenon known as "bursting," where the track- 
ing error, after reaching a steady-state behavior, bursts into oscillations of 
large amplitude over short intervals of time, have often been observed in 
simulations. Bursting cannot be excluded by the m.s.s. bounds obtained in 
the previous sections unless the reference signal is dominantly rich and/or 
an adaptive law with a dead zone is employed. Bursting is one of the most 
annoying phenomena in adaptive control and can take place even in sim- 
ulations of some of the ideal MRAC schemes of Chapter 6. The cause of 
bursting in this case could be the computational error which acts as a small 
bounded disturbance. There is a significant number of research results on 
bursting and other undesirable phenomena, mainly for discrete-time plants 
[2, 68, 81, 136, 203, 239]. We use the following example to explain one of 
the main mechanisms of bursting. 
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Example 9.4.1 (Bursting) Let us consider ttie following MRAC scheme: 

Plant X = ax + bu + d 

Reference Model Xm = —Xm + r, Xm{0) = 

Adaptive Controller 

9 = Pr[—eiujsgn{b)] , ei = x — Xj^ (9.4.1) 

The projection operator in (9.4.1) constrains to lie inside a bounded set, where 

1^1 < Mo and Mq > is large enough to satisfy \d*\ < Mq where 6* = [-^, \Y 
is the desired controller parameter vector. The input d in the plant equation is an 
arbitrary unknown bounded disturbance. Let us assume that \d{t)\ < do,Vi > for 
some do > 0. 

If we use the analysis of the previous sections, we can establish that all signals 
are bounded and the tracking error ei G S{do) , i.e., 

t 

2 



efdT <d^o{t-to) + ko, Vf > to > (9.4.2) 

where fcg depends on initial conditions. Furthermore, if r is dominantly rich, then 
ei, 9 = 9 — 9* converge exponentially to the residual set 

So= {ei, e'||ei| + |0'| <cdo] 

Let us consider the tracking error equation 

ei = -d + b9'^uj + d (9.4.3) 

and choose the following disturbance 

d = h{t)s&i{-b{9 -9*)^uj} 

where h{t) is a square wave of period IOOtt sec and amplitude 1, 

X if \x\ < do 

!o if a; > do 
-do if a; < —do 



satja;} = •^ do if a; > do 



and 9 is an arbitrary constant vector such that \9\ < Mo- It is clear that \d(t)\ < do 
Vt > 0. Let us consider the case where r is sufficiently rich but not dominantly 
rich, i.e., r{t) has at least one frequency but \r\ <^ do. Consider a time interval 
[ii, ti +Ti] over which |ei(t)| < do- Such an interval not only exists but is also large 
due to the uniform continuity of ei(i) and the inequality (9.4.2). Because |ei| < do 
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and < |r| <C do, we could have \b{9 — 9*)'^uj\ < do for some values of \d\ < Mo 
over a large interval [^2,^2 + ^2] C [ti,ti + T]. Therefore, for t G [^2,^2 + T2] we 
have d = —h{t)b{0— 9*) iv and equation (9.4.3) becomes 

ei = -ei + 6(6* - ^)^cD Vt G [is, ^2 + T2] (9.4.4) 

where uj = h{t)uj. Because r is sufficiently rich, we can establish that uj is PE and 
therefore 9 converges exponentially towards 0. If T2 is large, then 9 will get very 
close to as t — > ^2 + T2- If we now choose to be a destabilizing gain or a gain 
that causes a large mismatch between the closed- loop plant and the reference model, 
then as 9 ^ 9 the tracking error will start increasing, exceeding the bound of rfo- 
In this case d will reach the saturation bound do and equation (9.4.4) will no longer 
hold. Since (9.4.2) does not allow large intervals of time over which |ei| > do, we 
will soon have |ei| < do a-nd the same phenomenon will be repeated again. 

The simulation results of the above scheme for a=l, 6=1 , r = O.lsinO.Olt, 
do = 0.5, Mq = 10 are given in Figures 9.4 and 9.5. In Figure 9.4, a stabilizing 
9 = [—3, 4]^ is used and therefore no bursting occurred. The result with 9 = [0, 4]^, 
where 9 corresponds to a destabilizing controller parameter, is shown in Figure 9.5. 
The tracking error ei and parameter 9i{i), the first element of 9, are plotted as 
functions of time. Note that in both cases, the controller parameter 9i{t) converges 
to 9i, i.e., to —3 (a stabilizing gain) in Figure 9.4, and to (a destabilizing gain) 
in Figure 9.5 over the period where d = —h{t)b{9 — 9*)'^ uj. The value of ^2 = 4 is 
larger than ^2 = 1 and is responsible for some of the nonzero values of ei at steady 
state shown in Figures 9.4 and 9.5. V 

Bursting is not the only phenomenon of bad behavior of robust MRAC. 
Other phenomena such as chaos, bifurcation and large transient oscillations 
could also be present without violating the boundedness results and ni.s.s. 
bounds developed in the previous sections [68, 81, 136, 239]. 

One way to eliminate most of the undesirable phenomena in MRAC is to 
use reference input signals that are dominantly rich. These signals guarantee 
a high level of excitation relative to the level of the modeling error, that in 
turn guarantees exponential convergence of the tracking and parameter error 
to residual sets whose size is of the order of the modeling error. The use 
of dominantly rich reference input signals is not always possible especially 
in the case of regulation or tracking of signals that are not rich. Therefore, 
by forcing the reference signal to be dominantly rich, we eliminate bursting 
and other undesirable phenomena at the expense of destroying the tracking 
properties of the scheme in the case where the desired reference signal is not 
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Figure 9.4 Simulation results for Example 9.4.1: No bursting because of 
the stabilizing = [—3,4]^. 
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Figure 9.5 Simulation results for Example 9.4.1: Bursting because of the 
destabilizing 6 = [0,4]'''. 
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rich. Another suggested method for ehminating bursting is to use adaptive 
laws with dead zones. Such adaptive laws guarantee convergence of the 
estimated parameters to constant values despite the presence of modeling 
error provided of course the size of the dead zone is higher than the level 
of the modeling error. The use of dead zones, however, does not guarantee 
good transient performance or zero tracking error in the absence of modeling 
errors. 

In an effort to improve the transient and steady-state performance of 
MRAC, a high gain scheme was proposed in [148], whose gains are switched 
from one value to another based on a certain rule, that guarantees arbi- 
trarily good transient and steady state tracking performance. The scheme 
does not employ any of the on-line parameter estimators developed in this 
book. The improvement in performance is achieved by modifying the MRC 
objective to one of "approximate tracking." As a result, non-zero tracking 
errors remained at steady state. Eventhough the robustness properties of the 
scheme of [148] are not analyzed, the high-gain nature of the scheme is ex- 
pected to introduce significant trade-offs between stability and performance 
in the presence of unmodeled dynamics. 

In the following sections, we propose several modified MRAC schemes 
that guarantee reduction of the size of bursts and an improved steady-state 
tracking error performance. 

9.4.1 Modified MRAC with Unnormalized Adaptive Laws 

The MRAC schemes of Chapter 6 and of the previous sections are designed 
using the certainty equivalence approach to combine a control law, that 
works in the case of known parameters, with an adaptive law that provides 
on-line parameter estimates to the controller. The design of the control law 
does not take into account the fact that the parameters are unknown, but 
blindly considers the parameter estimates provided by the adaptive laws to 
be the true parameters. In this section we take a slightly different approach. 
We modify the control law design to one that takes into account the fact 
that the plant parameters are not exactly known and reduces the effect of 
the parametric uncertainty on stability and performance as much as possi- 
ble. This control law, which is robust with respect to parametric uncertainty, 
can then be combined with an adaptive law to enhance stability and per- 
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formance. We illustrate this design methodology using the same plant and 
control objective as in Example 9.4.1, i.e., 

Plant X = ax + bu + d 

Reference Model Xm = —Xm + r, Xm(0) = 

Let us choose a control law that employs no adaptation and meets the 
control objective of stability and tracking as close as possible even though 
the plant parameters a and b are unknown. 

We consider the control law 

u = Oqx + Cor + Ua (9.4.5) 

where ^O) cq are constants that depend on some nominal known values of 
a, b if available, and Ua is an auxiliary input to be chosen. With the input 
(9.4.5), the closed- loop plant becomes 

x= -x + b(9o + ^^—— ] x + bcor + bua + d (9.4.6) 

and the tracking error equation is given by 

ei = -ei + bOoei + bOoXm + bc^r + bua + d (9.4.7) 

where ^o = ^0 + ^^) cq = cq — \ are the constant parameter errors. Let us 

now choose 

s + 1 , , , , 

Ua = sgn(6)ei (9.4.8) 

TS 

where r > is a small design constant. The closed-loop error equation 
becomes 

ei = — E [be^Xm + bcQT + d] (9.4.9) 

Ts'^ + {T+\b\-TbeQ)s+\b\ 



If we now choose r to satisfy 



< r < -^ (9.4.10) 

l^ol 



the closed-loop tracking error transfer function is stable which implies that 
ei, ^ei e £oo and therefore all signals are bounded. 
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Another expression for the tracking error obtained using x = ei + x^ 
and (9.4.7) is 



TS 



ei 



{s + l){rs + \b\) 



or for \b\ / r we have 



ei 



\b\ 



\b\ 



[bOox + bcor + d] 



(w + d) 



TS+\b\ s+1. 



(9.4.11) 



(9.4.12) 



A 



where w = b{Oox + cor) is due to the parametric uncertainty. Because 
X e Coo, for any given r G (O,l/|0o|)) we can establish that there exists a 
constant wq > independent of r such that sup^ \iJ^{t)\ ^ ^0- It, therefore, 
follows from (9.4.12) that 



|ei(t)| < 



1^1 



\b\ 



|ei(0)| + 



1^1 



-(wo + do) (9.4.13) 



where do is the upper bound for \d(t)\ < do,\/t > 0. It is, therefore, clear 
that if we use the modified control law 



u = Oqx + Cor 



s + 1 



TS 



sgn(6)ei 



with 



< T < min 



|6|,^ 



(9.4.14) 



then the tracking error will converge exponentially fast to the residual set 

2r 



ei 



ei < 



\b\ 



-{wq + do) 



(9.4.15) 



whose size reduces to zero as r ^ 0. 

The significance of the above control law is that no matter how we choose 
the finite gains ^o, co, there always exist a range of nonzero design parameter 
values r for stability. Of course the further 9q is away from the desired 
9q where ^q = —^-5—, the smaller the set of values of r for stability as 
indicated by (9.4.14). Even though the tracking performance of this modified 
control law can be arbitrarily improved by making r arbitrarily small, we 
cannot guarantee that the tracking error converges to zero as t ^ c>o even 
when the disturbance d = 0. This is because the parameter error ^o,co 
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is nonzero and acts as a disturbance in the tracking error equation. The 
asymptotic convergence of the tracking error to zero in the case of d = can 
be reestabhshed if, instead of using the constant gains 0o,co in (9.4.5), we 
use an adaptive law to generate on-line estimates for the controller gains. 
Therefore, instead of combining (9.4.5) with Uq = with an adaptive law as 
we did in Chapter 6, we combine the modified control law 

s + 1 
u = eo(t)x + co(t)r sgn(fe)ei (9.4.16) 

TS 

with an adaptive law that generates 9Q(t),CQ(t), the estimates of Oq,Cq re- 
spectively. With (9.4.16) the tracking error equation may be written as 

ei = -ei + W'^LU-lbV^-^ei + d (9.4.17) 

TS 
T /J* f/i* „*lT n* g+l _* 1 , , Fo^ ..^iT 



where 6 = 9-9*, 9= [Oq, cq] ' , 6* = %,4] ' , 0* = -^, ^ 



x,r 



or 



ei = -(l + — ]ei + W^co -—e2 + d 

62 = ei (9.4.18) 

We develop the adaptive laws for ^O) cq by considering the following Lyapu- 
nov-like function 

where Zq > is an arbitrary constant to be selected. 

The time-derivative V along the solution of (9.4.18) may be written as 

V = -(l + M)e?-Me^ + (e, + e,)d + e,e,(/o-^-l' 

+ (ei + 62)6^^0; + \b\9'^ Pr[-{ei + e2)ujsgn{b)] (9.4.20) 

by choosing the adaptive law 

e = Pr[-(ei + e2)a;sgn(6)] (9.4.21) 

'-(ei + e2)c^sgn{b) if \9\ < Mq or 

if \9\ = Mo and 6i^(ei + e2)wsgn(6) >0 
/ — gTg) (ei + e2)a;sgn(6) otherwise 
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where |6'(0)| < Mq and Mq > \9*\. Selecting /q = ^ + 1, completing the 
squares and using the properties of projection, we can establish that 



V < 



\b[^2_\b[ 
2t ^ 2t 



eo + 






(9.4.22) 



which implies that ^,61,62 £ Coo and 61,62 £ S{tcP), i.e., the m.s.s. bound 
for 61, 62 can be made arbitrarily small by choosing an arbitrarily small r. In 
addition, x,uj €z Coo- Furthermore if d = 0, we can establish that 61, 62 -^ 
as t ^ 00. 

Let us now obtain an £oo-bound for 61. From (9.4.17) we have 



T.S 



61 



Ts2 + (r+|6|)s+|fe| 



(w + d) 



(9.4.23) 



where w = bO to. Because we have shown above that w £ £00 for any r > 0, 
we can treat w as a bounded disturbance term. As in the non- adaptive case 
we express ei as 



ei 



\b\ 



1 



TS+\b\ s+1 



(w + d) 



for |6| / r, which implies that 

|6| _Mt 



\ei{t)\ < 



\b\ 



|ei(0)| + 



2r 



1^1 



-{wo + do) 



(9.4.24) 



(9.4.25) 



where wq and do are the upper bounds for w and d respectively. It is therefore 
clear that the modified adaptive control scheme guarantees that the tracking 
error converges exponentially to the residual set 



5. 



ei 



|ei| < 



2r 



\b\ 



-{wq + do) 



(9.4.26) 



whose size can be made arbitrarily small by choosing an arbitrarily small r. 
The residual set is qualitatively the same as in the non-adaptive case. The 
difference is in the value of wq, the bound for the parametric uncertainty term 
bO^uj. One can argue that wq should be smaller in the adaptive case than in 
the non-adaptive case due to the learning capability of the adaptive scheme. 
Another significant difference is that in the absence of the disturbance, i.e.. 
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1000 2000 3000 4000 5000 6000 7000 8000 9000 10000 

(a) 




1000 2000 3000 4000 5000 6000 7000 8000 9000 10000 

(b) 



Figure 9.6 Simulation for (a) MRAC without modification; (b) modified 
MRAC with r = 0.5. 



d = 0, the modified adaptive scheme guarantees that ei ^ as t ^ oo for 
any r > 0. 

The significance of the modified adaptive control scheme is that it guar- 
antees m.s.s. and Coo bounds for the tracking error that can be made small 
by choosing a small design parameter r. This means that by the proper 
choice of T, we can significantly reduce bursting and improve the tracking 
error performance of the adaptive control scheme. 

We demonstrate the effectiveness of the modified scheme by simulating 
it with the same disturbance as in Example 9.4. f The simulation results 
with r = 0.5 (a moderate value for the design parameter) are shown in 
Figures 9.6. It can be seen that the bursting is suppressed by the additional 
compensation term. 

The methodology used in the above example can be extended to the 
general case of MRAC with unnormalized adaptive laws. 
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9.4.2 Modified MRAC with Normalized Adaptive Laws 

The method used in the previous section can be extended to MRAC with 
normalized adaptive laws. In this section we briefly describe two modiflca- 
tions that can be used to improve the performance of MRAC with normalized 
adaptive laws [36, 39, 211, 212]. 
We consider the general plant 

yp = kp^P^{up + du) (9.4.27) 

where kp, Zp, and Rp satisfy assumptions PI to P4 given in Section 6.3 and 
du is a bounded input disturbance. For simplicity we assume that kp is 
known. The coefficients of Zp,Rp are completely unknown. The reference 
model is given by 

Vm = Wm{s)r = km^P^r (9.4.28) 

where Wm{s) satisfles assumptions Ml and M2 given in Section 6.3. 
We consider the control law 

Up = el {t)ujQ + clr + ua (9.4.29) 

where 6*0 = [Oj ,9l ,9^]^ ,ujq, = [ujJ , ujJ , yp]'^ , c^ = km/kp,uJi = ^Up,uJ2 = 

^T^j/p, a{s) = [s"~^, ■ ■ ■ ,s, 1]^ and A = AoZm is a Hurwitz polynomial of 
degree n — 1. 

The auxiliary input Ua is to be chosen for performance improvement. The 
parameter vector ^o(^) may be generated by any one of the robust adaptive 
laws of Chapter 8. As an example let us use the gradient algorithm with 
projection based on the parametric plant model z = 9q~^ cf^o — d^^, developed 
using equation (9.3.62), where z = Wmis)up — CQyp,dr, = — -^ — Wmdu, i.e.. 



9o -- 


= Pr[re</.o] 


e - 


z-eUo 

m? 


m' -- 


= l + n1, nl = m. 


rhs = 


= -5oms + ul + yp, 


(po = 


= Wm{s)uJo 



(9.4.30) 
ms{0) = 
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9jujo + di + 



^Wm(s) 



ei 



Cis) 



Figure 9.7 A closed-loop representation of the modified MRAC scheme. 

where the projection operator Pr[-] constrains ^o to satisfy |0o(^)| < Mq \/t > 
for some Mq > I^qI'-'^ = r"*" > and Jq > is chosen so that Wm{s) and 
the filters for generating ujq are analytic in Re[s] > —5o/2. 

With (9.4.29) the tracking error equation may be written as 



ei 



-Wmis)[eQUJo + Ua + dl] 



(9.4.31) 



where di = ~^ " du, ^o = ^o — ^o ^y following the same procedure as the 
one used to develop equation (9.3.65). The idea now is to choose Ua so 
that all signals in the closed-loop plant remain bounded as in the case of 
Ua = and the effect of 9qUJq + di on ei is reduced as much as possible. 
We present two different methods that lead to two different choices of Ua 
achieving similar results. 



Method 1. This method is developed in [36, 212] and is described as 
follows: 

We choose Ua as 

Ua = -C{s)ei (9.4.32) 

where C(s) is a proper transfer function to be designed. With (9.4.32) the 
tracking error system may be represented by the Figure 9.7. 

The set of all stabilizing compensators C{s) for this system is given by 



C{s) 



Q{s) 



(9.4.33) 



1 - ^W^{s)Q{s) 
where Q{s) ranges over the set of all stable rational transfer functions [36]. 
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With this choice of C(s), the tracking error equation becomes 



ei 



-Wmis)Qis) 



-Wmis)[eJiO0 + dl] 



which imphes that 



||eii||oo < ||^m||l(||(^o '^o)t||oo + IMltlloo) 

where hm is the impulse response of the system with transfer function 
^Wm{s){l —■^Wm{s)Q{s)). The problem now reduces to choosing a proper 
stable rational function Q{s) to minimize the £i norm of hm, i-e., to make 
||/im||i as small as possible. 



Lemma 9.4.1 The transfer function 



Q{s) 



4W-\s) 



(9.4.34) 



{ts+ 1)"* 

where n* is the relative degree of the plant and t > is a design constant 
guarantees that 



\h 



ml 



OS r 







Proof We have 



-Wm{s)Q{s) 



Wmjs) ^ JTS+ir' -1W„,{S) 
c* {ts + 1)"* C* 



TS- 



W^{s) 



_TS+1 (tS+1)2 (T-s+l)n-^ 

Hence, 

||/lm||l<T||/lo||l[||/ll||l + ||/l2||l + ---||/i„.||l] 

where ho{t) is the impulse response of sWm{s) / Cq and hi{t) the impulse response of 
1/(ts + 1)*, i = 1, 2, . . . , n*. It is easy to verify that ||/io||ii II ^i 111 are bounded from 
above by a constant c > independent of t. Therefore ||/im||i < tc and the proof 
is complete. D 



Using (9.4.32), (9.4.33) and (9.4.34), the control law (9.4.29) becomes 



n„ 



C{s) 



e^{t)iUo + clr - C{s)ei 
{ts + 1)"* - 1 



(9.4.35) 
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which together with the adaptive law (9.4.30) and Cg = km/kp describe the 
modified MRAC scheme. 

The control law (9.4.35) poses no implementation problems because C(s) 
is proper, and ei is measured. 

Theorem 9.4.1 The MRAC scheme described by (94.30) and (94.35) with 
T e (0, l/^o) guarantees the following properties when applied to the plant 
(9.4.27): 

(i) All signals are bounded. 

(ii) The tracking error satisfies 

lim sup |ei(To)| < t{c + do) 

where do is an upper bound for the disturbance d^ and c > is a 
constant independent of t. 

(iii) When du = 0, ei(t) —i- as t —i- 00. 

The proof of Theorem 9.4.1 follows from the proofs of the standard robust 
MRAC schemes and is left as an exercise for the reader. 

Theorem 9.4.1 indicates that the steady state value of ei can be made 
arbitrarily small by choosing a small design parameter r. Small r implies the 
presence of a high gain equal to 1/r in the control law (9.4.35). Such a high 
gain is expected to have adverse effects on robust stability demonstrating the 
classical trade-off between robust stability and nominal performance that is 
present in every robust control scheme in the nonadaptive case. In the 
presence of unmodeled dynamics it is expected that r has to meet a lower 
bound for preservation of robust stability. 

Method 2. This method is developed and analyzed in [39, 211] and is 
described as follows: 

We consider the tracking error equation (9.4.31) 

ei = —Wmis){9QUJo + Ua + di) 
'^0 
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Using Swapping Lemma A.l we have 

w^,{.s)ejLoo = eJ<Po + w,{s){Wi,{s)Lo^)eo 

where the elements of Wc, Wb are strictly proper transfer functions with the 
same poles as VFm(s). From the expression of the normalized estimation 
error in (9.4.30), we have 

ern^ = —6q (po — dr, 

where dr, = Wm{s)di. Therefore, tm"^ = —Ojcpo — Wm{s)di leading to the 
tracking error equation 

1 



ei = - 

Co L 



-em^ + WciWbUJf; )eo + WmUa 



Because e, Wc, Wb, loq, 6q are known, the input Ua is to be chosen to reduce 
the effect of 9q,9q on ei. 
Let us choose 

Ua = -Q{s)[-em^ + Wc{s){Wb{s)u;J)eo] = -Q{s)W„,{s){ejLOo + di) 

(9.4.36) 
where Q{s) is a proper stable transfer function to be designed. With this 
choice of Ua, we have 

ei = \[{1 - Wra{s)Q{s))Wrn{s){e^COo + di)] 

Cq 
which implies that 

||eiJ|oo < ||/lm||l(||(^C)'wo)t||oo + IMltlloo) 

where hmit) is the impulse response of (1 — Wmis)Q(s))Wm{s). 
As in Method 1 if we choose Q{s) as 

Q{s) = j^f:^ (9.4.37) 

we can establish that ||/im||i ^ as r ^ 0. 
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With (9.4.37) the modified control law (9.4.29), (9.4.36) becomes 
Up = e^LOo + 4r - ^\^ {-em^ + WMiWb{s)o4)~eo) (9.4.38) 

where Wc-, Wh can be calculated from the Swapping Lemma A.l and 9o = 9o 
is available from the adaptive law. 

Theorem 9.4.2 The modified MRAC scheme described by (9.4.30), (9.4.38) 
with T E (0, l/5o) guarantees the following properties when applied to the 
plant (9.4.27): 

(i) All signals are bounded. 

(ii) The tracking error e\ satisfies 

lim sup |ei(To)| < t{c^ do) 

where do is an upper bound for the disturbance d„ and c> is a finite 
constant independent of t. 

(iii) When du = we have |ei(t)| ^ as t ^ cx>. 

The proof of Theorem 9.4.2 follows from the proofs of the robust MRAC 
schemes presented in Section 9.3 and is given in [39]. 

In [39], the robustness properties of the modified MRAC scheme are 
analyzed by applying it to the plant 

Z(s) 

where fiAmis) is a multiplicative perturbation and fi > 0. It is established 
that for T e {Tmin, j-) where < Tmin < j-, there exists a fi*{Tmin) > such 
that all signals are bounded and 

lim sup |ei(To)| < tc + fic 

where c > is a constant independent of r, /x. The function n*{Tmin) is 
such that as Tmin -^ 0, n*{Tmin) -^ demonstrating that for a given size 
of unmodeled dynamics characterized by the value of /x*,t cannot be made 
arbitrarily small. 
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Remark 9.4.1 The modified MRAC schemes proposed above are based on 
the assumption that the high frequency gain kp is known. The case of 
unknown kp is not as straightforward. It is analyzed in [37] under the 
assumption that a lower and an upper bound for kp is known a priori. 

Remark 9.4.2 The performance of MRAC that includes transient as well 
as steady-state behavior is a challenging problem especially in the 
presence of modeling errors. The effect of the various design param- 
eters, such as adaptive gains and filters, on the performance and ro- 
bustness of MRAC is not easy to quantify and is unknown in gen- 
eral. Tuning of some of the design parameters for improved perfor- 
mance is found to be essential even in computer simulations, let alone 
real-time implementations, especially for high order plants. For addi- 
tional results on the performance of MRAC, the reader is referred to 
[37, 119, 148, 182, 211, 227, 241]. 

9.5 Robust APPC Schemes 

In Chapter 7, we designed and analyzed a wide class of APPC schemes for 
a plant that is assumed to be finite dimensional, LTI, free of any noise and 
external disturbances and whose transfer function satisfies assumptions PI 
to P3. 

In this section, we consider APPC schemes that are designed for a sim- 
plified plant model but are applied to a higher-order plant with unmodeled 
dynamics and bounded disturbances. In particular, we consider the higher 
order plant model which we refer to it as the actual plant 

Vp = Go(s)[l + A„,(s)](up + du) (9.5.1) 

where Gq(s) satisfies PI to P3 given in Chapter 7, Am(s) is an unknown 
multiplicative uncertainty, du is a bounded input disturbance and the overall 
plant transfer function G(s) = Go{s){l+Am{s)) is strictly proper. We design 
APPC schemes for the lower-order plant model 

yp = Go{s)up (9.5.2) 

but apply and analyze them for the higher order plant model (9.5.1). The ef- 
fect of perturbation Am and disturbance d^ on the stability and performance 
of the APPC schemes is investigated in the following sections. 
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Plant 




Vm +/grei 



Figure 9.8 Closed-loop PPC schemes with unmodeled dynamics and 
bounded disturbances. 

We first consider the nonadaptive case where Go{s) is known exactly. 



9.5.1 PPC: Known Parameters 

Let us consider the control laws of Section 7.3.3 that are designed for the 
simplified plant model (9.5.2) with known plant parameters and apply them 
to the higher order plant (9.5.1). The block diagram of the closed-loop plant 
is shown in Figure 9.8 where C(s) is the transfer function of the controller. 
The expression for C(s) for each of the PPC laws developed in Chapter 7 is 
given as follows. 

For the control law in (7.3.6) and (7.3.11) of Section 7.3.2 which is based 
on the polynomial approach, i.e., 



Qin^Up — P[yin ~ yp)i LQ„iKp + rZp — A 



(9.5.3) 



where Qm{s) is the internal model of the reference signal j/m, i-e., Qmis)y. 

0, we have 

P{s) 



C{s) 



(9.5.4) 



Qrn{s)L{s) 

The control law (7.3.19), (7.3.20) of Section 7.3.3 based on the state- variable 
approach, i.e.. 



Ae + Bup - KoiC'^e - ei) 



-Kce, Up 



Qi 



(9.5.5) 
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where Kc satisfies (7.3.21) and Kq satisfies (7.3.22), can be put in the form 
of Figure 9.8 as foiiows: 
We have 



Tn-1/ 



and 



I.e., 



and, therefore. 



e{s) = {sI-A + KoC ' )-'{Bup + Koei) 
\p = -KcisI -A + KoC^)-\Bup + Koei) 

K,{sI-A + KoC^)-^Ko 
1 + K^{sl -A + KoC^)-^B^^ 

K,{.sI-A + KoC^)-'Ko Qi{.s) 



Un 



C{s) 



(9.5.6) 



(1 + K,(sl -A + KoC^y^B) Q^(.s) 

For the LQ control of Section 7.3.4, the same control law (9.5.5) is used, 
but Kc is calculated by solving the algebraic equation 

A~^P + PA- PBX-'^B'^P + CC^ = 0, Kc = X~'^B^P (9.5.7) 



Therefore, the expression for the transfer function C{s) is exactly the same 
as (9.5.6) except that (9.5.7) should be used to calculate Kc. 

We express the closed-loop PPC plant into the general feedback form 
discussed in Section 3.6 to obtain 

C -CG 



Up 



l + CG l + CG 
GG G 



l + CG l + CG 



du 



(9.5.8) 



where G = Go(l + A^) is the overall transfer function and G is different 
for different pole placement schemes. The stability properties of (9.5.8) are 
given by the following theorem: 

Theorem 9.5.1 The closed-loop plant described by (9.5.8) is internally sta- 
ble provided 

||To(s)A„(s)|U<l 

where Tq{s) = ^T^qq is the complementary sensitivity function of the nomi- 
nal plant. Furthermore, the tracking error e\ converges exponentially to the 
residual set 



V, 



{ei ||ei| < cdo} 



(9.5.9) 
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where do is an upper bound for \du\ and c> is a constant. 

Proof The proof of the first part of Theorem 9.5.1 follows immediately from equa- 
tion (9.5.8) and the small gain theorem by expressing the characteristic equation of 
(9.5.8) as 

To establish (9.5.9), we use (9.5.8) to write 



ei 



CG 



1 + CG 



G ^ 1 G ^ 

2^"+ 1 + CG"" i + CG^"+l + CG" 



It follows from (9.5.4), (9.5.6) that the controller C{s) is of the form G{s) 
for some Go(s). Therefore 



Cajs) 



Qm + GqG Qm + CqG 

where G = Go(l + A„i). Since QmUm = and the closed-loop plant is internally 
stable due to ||To(s)Am(s)||oo < 1, we have 

= (l + Am)GoQm 

Qm + GqGo -I- AmGoGo 

where e^ is an exponentially decaying to zero term. Therefore, (9.5.9) is implied by 
(9.5.10) and the internal stability of the closed-loop plant. □ 



It should be pointed out that the tracking error at steady state is not 
affected by ym despite the presence of the unmodeled dynamics. That is, if 
(i„ = and A^ 7^ 0, we still have ei(t) ^ as i ^ 00 provided the closed- 
loop plant is internally stable. This is due to the incorporation of the internal 
model of Hm in the control law. If Qm{s) contains the internal model of du 
as a factor, i.e., Qrn{s) = Qd{s)Q„i{s) where Qd{s)du = and Qm{s)ym = 0, 
then it follows from (9.5.10) that ei = ej, i.e., the tracking error converges 
to zero exponentially despite the presence of the input disturbance. The 
internal model of du can be constructed if we know the frequencies of du- 
For example, if du is a slowly varying signal of unknown magnitude we could 
choose Qd{s) = 8. 

The robustness and performance properties of the PPC schemes given by 
Theorem 9.5.1 are based on the assumption that the parameters of the mod- 
eled part of the plant, i.e., the coefficients of Go{s) are known exactly. When 
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the coefficients of Go(s) are unknown, the PPC laws (9.5.3) and (9.5.5) are 
combined with adaptive laws that provide on-line estimates for the unknown 
parameters leading to a wide class of APPC schemes. The design of these 
APPC schemes so that their robustness and performance properties are as 
close as possible to those described by Theorem 9.5.1 for the known param- 
eter case is a challenging problem in robust adaptive control and is treated 
in the following sections. 

9.5.2 Robust Adaptive Laws for APPC Schemes 

The adaptive control schemes of Chapter 7 can meet the control objective 
for the ideal plant (9.5.2) but not for the actual plant (9.5.1) where Amis) / 
0, du 7^ 0. The presence of A^ and/or du may easily lead to various types 
of instability. As in the case of MRAC, instabilities can be counteracted 
and robustness properties improved if instead of the adaptive laws used in 
Chapter 7, we use robust adaptive laws to update or estimate the unknown 
parameters. 

The robust adaptive laws to be combined with PPC laws developed for 
the known parameter case are generated by first expressing the unknown 
parameters of the modeled part of the plant in the form of the parametric 
models considered in Chapter 8 and then applying the results of Chapter 8 
directly. 

We start by writing the plant equation (9.5.1) as 

Rpyp = Zpil + Arn)iup + du) (9.5.11) 

where Zp = 61^ an-i{s) , Rp = s" + 9*J an-i{s); 01, 0^ are the coefficient 
vectors of Zp, Rp respectively and a„_i(s) = [s"'~^, s"~^, . . . ,s, 1]^ . Filtering 
each side of (9.5.11) with ^ \. , where Ap{s) = s" + Ais"~^ + ■ ■ ■ + A„ is 
Hurwitz, we obtain 

z = 0Z^4> + r] (9.5.12) 



where 



/^^ r /i^ I /^^ I 1 I 

^-^^yp, 9p = [e, ,9, ] 



qI-i('S) «I-i(g) 

A ^^' A ^^ 
ivp i\p 



hT 



, r] = -^[AmUp + (1 + Am)du\ 
Ap 
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Equation (9.5.12) is in the form of the hnear parametric model considered 
in Chapter 8, and therefore it can be used to generate a wide class of robust 
adaptive laws of the gradient and least-squares type. As we have shown 
in Chapter 8, one of the main ingredients of a robust adaptive law is the 
normalizing signal m that needs to be chosen so that '-^^ ^ ^ C^. We apply 
Lemma 3.3.2 and write 



\vit)\ < 



Zp{s) 



Ap(s] 



Am(s) 



iUp)t\\25 + 



2<5 



Zp{s){l + Amis)) 



Ap(s) 



25 



dp 



+tt (9.5.13) 



for some 5 > 0, where e^ is an exponentially decaying to zero term and 
do = supj |c?«(t)|. Similarly, 



\m\<Y: 



i=l 



Ap(s) 



iUp)t\\25+ \\{yp)t\\25) 



(9.5.14) 



2<5 



The above H25 norms exist provided 1/Ap(s) and /S.m{s) are analytic in 



Re[s] > -5/2 and 



Zr) An 



is strictly proper. Because the overall plant transfer 



function G{s) and Gq{s) are assumed to be strictly proper, it follows that 

'Z A 

Gq/S.„i and therefore ^ "' are strictly proper. Let us now assume that 
Am(s) is analytic in Re[s] > —5q/2 for some known 5q > 0. If we design 
Ap(s) to have roots in the region Re[s] < —5o/2 then it follows from (9.5.13), 
(9.5.14) by setting S = Sq that the normalizing signal m given by 



m 



1 + IWptWho + WvptWho 



bounds T], (j) from above. The signal m may be generated from the equations 



9 o 

m = 1 + rig, 



rris 



rig = nig 
Soms + ul + yl, 771^(0) = 



(9.5.15) 



Using (9.5.15) and the parametric model (9.5.12), a wide class of robust 
adaptive laws may be generated by employing the results of Chapter 8 or by 
simply using Tables 8.2 to 8.4. 

As an example let us consider a robust adaptive law based on the gradient 
algorithm and switching ir-modification to generate on-line estimates of 6* 
in (9.5.12). We have from Table 8.2 that 



Ted) — a^TOr, 
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Z — <p 2 1,2 2 

' — m =l + ng, rig = nis 



m'^ 



yp (9.5.16) 



m.o 



O"., 



Ap(s 

-Joms + Up + yp, ms(0) = 
if |6'p| < Mo 

ao(g-l) if Mo < l^pl < 2Mo 
ao if \9p\ > Mo 



where 0p is the estimate of 9*, Mq > |6'*|, ao > and F = T^ > 0. As estab- 
hshed in Chapter 8, the above adaptive law guarantees that (i) e, en^, 6p, 9p G 
£oo, (ii) e, e^s, 9p £ S{rf /m?) independent of the boundedness of (/>, z, m,. 

The adaptive law (9.5.16) or any other robust adaptive law based on para- 
metric model (9.5.12) can be combined with the PPC laws (9.5.3), (9.5.5) 
and (9.5.7) to generate a wide class of robust APPC schemes as demonstrated 
in the following sections. 

9.5.3 Robust APPC: Polynomial Approach 

Let us combine the PPC law (9.5.3) with a robust adaptive law by replac- 
ing the unknown polynomials Rp, Zp of the modeled part of the plant with 
their on-line estimates Rp(s,t), Zp(s,t) generated by the adaptive law. The 
resulting robust APPC scheme is summarized in Table 9.5. 

We like to examine the properties of the APPC schemes designed for 
(9.5.2) but applied to the actual plant (9.5.1) with Am(s) / and du / 0. 

As in the MRAC case, we first start with a simple example and then 
generalize it to the plant (9.5.1). 

Example 9.5.1 Let us consider the plant 

yp= — (1 + A„(s))up (9.5.17) 

s + a 

where a,b are unknown constants and Am(s) is a multiplicative plant uncertainty. 
The input Up has to be chosen so that the poles of the closed-loop modeled part 
of the plant (i.e., with Am(s) = 0) are placed at the roots of A*{s) = {s + 1)^ 
and Up tracks the constant reference signal r/m = 1 as close as possible. The same 
control problem has been considered and solved in Example 7.4.1 for the case where 

Amis) = 0. 
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Table 9.5 Robust APPC scheme: polynomial approach 



Actual plant 


yp= |^(l + A„)(np + d„) 


Plant model 


0; = [ef,9fr,ais) = an-iis) 


Reference 
signal 


Qrn{s)yrn = 


Assumptions 


f7 

(i) Modeled part of the plant y^ = jf-Up and Qm{s) 
satisfy assumptions PI to P3 given in Section 7.3.1; 
(ii) Am{s) is analytic in Re[s] > —5o/2 for some 
known ^o > 


Robust 
adaptive law 


Use any robust adaptive law from Tables 8.2 to 8.4 
based on the parametric model z = 0*~^ cf> + r] with 

^ - Ap{s)yP''P - lAp(s)^P' Ap{s)yp\ 
1] = j^[Am{Up + du) + du] 


Calculation of 

controller 

parameters 


Solve for L(s,t) = s''-hl^it)an-2{s) 

P{s,t) =p^{t)an+q-i{s) from the equation 

L{s,t) • Q^{s) ■ Rp{s,t) + P{s,t) ■ Zp{s,t) = A*{s), 

where Zp{s,t) = ej{t)a{s), Rp{s,t) = s" + 6'J(t)a(s) 


Control law 


Up = {A- LQm)\up - P^iVp - Vm) 


Design 
variables 


A(s) = Ap{s)Aq{s), Ap,Ag are monic and Hurwitz 
of degree n and q — 1 respectively and with roots 
in Re[s] < — 5o/2; A*{s) is monic Hurwitz of degree 
2n + q—l with roots in Re[s] < —5o/2; Qm{s) is monic 
of degree q with nonrepeated roots on the joj-axis 
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We design each block of the robust APPC for the above plant as follows: 
Robust Adaptive Law The parametric model for the plant is 

z = e;^(i> + r? 

where 

z= -—^Vp, Op = [b,a]^ 

0= — --rK'-2/p]^' ?y = — — rA„(s)up 
s + A s + \ 

We assume that Am(s) is analytic in Re[s] > —Sq/2 for some known 6o > and 
design A > So/2. Using the results of Chapter 8, we develop the following robust 
adaptive law: 

9p = Pr{r(e(/. -0-^6'p)}, F = F^ > (9.5.18) 



z ■ 



eJ^ 



P ^ ™2 _ 1 I „2 „2 



e = ^ — , m =l + n^, n 

nis = -(5oms + |up|^ + li/pl^, ms(0) = 
r if |0p| < Mo 

(67-1)^0 ifMo<|0p|<2Mo 
(To if l^pl > 2Mo 

where Op = [6, a]^; Pr{-} is the projection operator which keeps the estimate \b{t)\ > 
60 > Vt > as defined in Example 7.4.1 where 60 is a known lower bound for |6|; 
and Mq > |0*|,f7o > are design constants. 

Control Law The control law is given by 

Up = -—^Up - (pis + po)— — r(2/p- Vrn) (9.5.19) 

where pi , po satisfy 

s-{s + a) + [pis + po) • & = (s + 1)^ 

leading to 

2-a 1 

Pi = -^—, Pa= J 

b b 

As shown in Chapter 8, the robust adaptive law (9.5.18) guarantees that 
(i) €,6171,9 G £00, (ii) e,em,() e S{rf' /vn?) 
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Because of the projection that guarantees \b{t)\ > 60 > Vi > 0, we also have that 
POiPi G £00 and Pq,Pi G S{Tf' /m^). Because 



I*?! 



s + A 



A,„(s) 



A 



A, 



(9.5.20) 



25o 



we have PQ^Pi^e, em, 9 G iS(A|). 

We use the properties of the adaptive law to analyze the stability properties of 
the robust APPC scheme (9.5.18) and (9.5.19) when applied to the plant (9.5.17) 
with Am(s) 7^ 0. The steps involved in the analysis are the same as in the ideal 
case presented in Chapter 7 and are elaborated below: 

Stepl. Express Up,yp in terms of the estimation error. As in Example 7.4.1, 
we define the states 



1 



Up, (p2 



1 



s + A 
From the adaptive law, we have 

2 _ 



s + X 



Vp, <t)n 



1 



s + A' 



em 



s 1 

^T^Vp - Sp ^-^[up,-yp]'^ = -<p2-0j[(j)i,(l)2V 

5 -f- A S -t- A 



I.e., 



9i — a<p2 — em 



(9.5.21) 



From the control law, we have 

Up = \<f)i + pi4>2 + Po(f)2 + Pid4>m + Pl0m 

Because Up = <j)i-\- \4>i, it follows from above and the equation (9.5.21) that 

(/)i = -piHi - [pia - pa)4)2 - pierri^ + y™ (9.5.22) 

where y^ = Pi4>m + Pn4>m e £00 due to po,Pi G £00- Combining (9.5.21), (9.5.22), 
we obtain exactly the same equation (7.4.15) as in the ideal case, i.e.. 



A{t)x + bi{t)em'^ + 622/™ 
xi + Xxi, yp = -±2 - Xx2 



(9.5.23) 



A 



where x = [a^i, 2:2] = [0i, (p: 



A{t) 



-pib -{pia-po) 



h{t) 



-Pi 
-1 



Note that in deriving (9.5.23), we only used equation em"^ 



9l (j) and the 



control law (9.5.19). In both equations, 77 or Am(s) do not appear explicitly. 
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Equation (9.5.23) is exactly the same as (7.4.15) and for each fixed t, we have 
det{sl — A{t)) = (s + 1)^. However, in contrast to the ideal case where em, ||A(t)|| G 
i^2 H'Coo, here we can only establish that em, ||^(i)|| G S{IS.'^) {~\Coo, which follows 
from the fact that em, 6 G S{I\2)C\^ootG G 'Coo and \h{t)\ > bo guaranteed by the 
adaptive law. 

Step 2. Show that the homogeneous part of (9.5.23) is e.s. For each fixed 
t, det{sl - A{t)) = (s + a)s + b{pis + po) = {s + 1)^, i.e., X{A{t)) = -l,Vt > 

0. From L,b,Pi,Pa e S{Al)f]Coo, we have ||i(t)|| G S{Al)f]Coo. Applying 
Theorem 3.4.11(b), it follows that for A2 < A* for some A* > 0, the matrix A{t) 
is u.a.s. which implies that the transition matrix <l>(t,T) of the homogeneous part 
of (9.5.23) satisfies 

||$(f,T)|| < fcie~''=(*-^\ V^>r>0 

for some constants fci, fc2 > 0. 

Step 3. Use the B-G lemma to establish signal boundedness. Proceeding the 
same way as in the ideal case and applying Lemma 3.3.3 to (9.5.23), we obtain 

\x{t)\,\\x\\<c\\em^+c 

where ||(-)|| denotes the C2S norm ||(-)t||2(5 for any < S < min[(5o,2fc2] and c > 
denotes any finite constant. From (9.5.23), we also have 

IkplUbpll <c\\em^\\+c 

Therefore, the fictitious normalizing signal nil = 1 + ||Mp|P + ||2/p|P satisfies 

nif < c\\em \\ + c 

The signal mj bounds m,x,Up,yp from above. This property of nif is established 
by using Lemma 3.3.2 to first show that ipi/nif, 4>2/fnf and therefore x/ruf G Coo- 
From 6 < 6q we also have that m/rrif G £00 • Because the elements of A{t) are 
bounded (guaranteed by the adaptive law and the coprimeness of the estimated 
polynomials) and em G Coo, it follows from (9.5.23) that x/m,f G Coo and therefore 
Up/m,f, yp/m,f G Coo- The signals (/<i, 4>2, x, Up, yp can also be shown to be bounded 
from above by m due to A > 60/ 2. We can therefore write 



mj < c||emm/|p + c= c+c e~'"-*~'^> g'' {T)mj{T)d' 







where g = em, G S{A2). Applying B-G Lemma III, we obtain 

Jo 
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Because cj g^{T)dT < cA2{t — s) + c, it follows that for CA2 < S, we have rrif G Ccc- 
Prom jUf G Coo, we have x, Up, yp, m G C^c and therefore all signals are bounded. 
The condition on A2 for signal boundedness is summarized as follows: 

CA2 < mm[VS, cA*], < S < min[(5o, 2^2] 

where as indicated before A* > is the bound for A2 for A{t) to be u.a.s. 

Step 4. Establish tracking error bounds. As in the ideal case considered in 

Example 7.4.1 (Step 4), we can establish by following exactly the same procedure 

that 

s(s + X) ^ s + A • 1 A 1 

(s+1)"^ (s+1)^ S + A s + A 

This equation is exactly the same as in the ideal case except that em, a, 6 G ^(Al) 
instead of being in £2- Because yp,Up,m G £00, it follows that 

em^, (a— —- 2/p - 6— — -Wp) G 5(A2) 

s + A S -f- A 

Therefore by writing f^^J^^2 = 1 + ^jzjts— , using ern^ G ^(Aj) and applying 
Corollary 3.3.3 to (9.5.24), we obtain 

t 
eldT<cAlt + c (9.5.25) 



which implies that the mean value of ef is of the order of the modeling error char- 
acterized by A2. 

Let us now simulate the APPC scheme (9.5.18), (9.5.19) applied to the plant 
given by (9.5.17). For simulation purposes, we use a=— 1,6=1 and Am(s)= ~ ^^ . 
The plant output response yp versus t is shown in Figure 9.9 for different values 
of ^ that indicate the size of Am{s). As /x increases from 0, the response of yp 
deteriorates and for /z = 0.28, the closed loop becomes unstable. V 



Remark 9.5.1 The calculation of the maximuni size of unmodeled dynam- 
ics characterized by A2 for robust stability is tedious and involves sev- 
eral conservative steps. The most complicated step is the calculation 
of A* using the proof of Theorem 3.4.11 and the rate of decay of the 
state transition matrix of A(t). In addition, these calculations involve 
the knowledge or bounds of the unknown parameters. The robustness 
results obtained are therefore more qualitative than quantitative. 



n=o.o 

H=0.05 

H=0.1 

H=0.2 



Figure 9.9 Plant output response for the APPC scheme of Example 9.5.1 
for different values of ^u. 

Remark 9.5.2 In the above example the use of projection guarantees that 
1^(^)1 > ^0 > Vt > where fco is a known lower bound for |6| and 
therefore stabilizability of the estimated plant is assured. As we showed 
in Chapter 7, the problem of stabilizability becomes more difficult to 
handle in the higher order case since no procedure is yet available 
for the development of convex parameter sets where stabilizability is 
guaranteed. 

Let us now extend the results of Example 9.5.1 to higher order plants. 
We consider the APPC scheme of Table 9.5 that is designed based on the 
plant model (9.5.2) and applied to the actual plant (9.5.1). 

Theorem 9.5.2 Assume that the estimated polynomials Rp{s , t) , Zp(s , t) of 
the plant model are such that RpQm, Zp are strongly coprime at each time t. 
There exists a 5* > Q such that if 



,2^ - - , .A 



c(/o + A^) < (5*, wherein 



2 



Zp{s) 



Ap{s) 



A„(s) 



25o 
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then the APPC schemes of Table 9.5 guarantee that all signals are hounded 
and the tracking error ei satisfies 

/ ejdT < c{Al + do + /o)^ + c, Vt > 
Jo 

where fo = in the case of switching-a and projection and fo > in the 
case of fixed-a(fo = a), dead zone (fo = go) and t-raodification (fo = uo) 
and do is an upper bound for \du\- 

The proof of Theorem 9.5.2 for d„ = follows directly from the analysis 
of Example 9.5.1 and the proof for the ideal case in Chapter 7. When d^ / 
the proof involves a contradiction argument similar to that in the MRAC 
case. The details of the proof are presented in Section 9.9.1. 

Remark 9.5.3 As discussed in Chapter 7, the assumption that the esti- 
mated time varying polynomials RpQm,Zp are strongly coprime can- 
not be guaranteed by the adaptive law. The modifications discussed 
in Chapter 7 could be used to relax this assumption without changing 
the qualitative nature of the results of Theorem 9.5.2. 

9.5.4 Robust APPC: State Feedback Law 

A robust APPC scheme based on a state feedback law can be formed by 
combining the PPC law (9.5.5) with a robust adaptive law as shown in 
Table 9.6. The design of the APPC scheme is based on the plant model 
(9.5.2) but is applied to the actual plant (9.5.1). We first demonstrate the 
design and analysis of the robust APPC scheme using the following example. 

Example 9.5.2 Let us consider the same plant as in Example 9.5.1, 

Vp = j-^{l + Am{s))up (9.5.26) 

which for control design purposes is modeled as 



Vp 



where a,b are unknown and Am(s) is a multiplicative plant uncertainty that is 
analytic in Re[s] > —5q/2 for some known 6q > 0. The control objective is to 
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Table 9.6 Robust APPC scheme: state feedback law 



Actual plant 



yp= if (1 + ^m)(«P + dn 



Plant model 



yP ~ Rr, ^p 



Reference 

signal 



Qm{s)ym = 



Assumptions 



Same as in Table 9.5 



Robust 
adaptive law 



Same as in Table 9.5; it generates the estimates 

Zp(.s,t),Rp(.s,t) 



k = Ae + Bup- Ko{t){C^e - d), e G Tl'^+i 



A-- 



^p^r. 



lW 



'ra+g-l 







. 5 = ^2(0, C^ = [1,0,...,0] 



Sn+^ + e'l{t)an+q-is) 



State observer 



ZpQl = 02 it)an+q-i{s) 

Ko = a*- ei,A%s) = s"+9 + a*^an+g-is) 

ei = yp- Vm 



Calculation of 

controller 

parameters 



Solve Kc{t) from 

dei{.sl- A + BKc) = Al{s) 

at each time t 



Control law 



-Kc{t)e, Up 



-Ur, 



Qi{s), A*^{s), A*(s) monic of degree q,n + q,n + q, 
respectively, with roots in Re[s] < —6o/2; A*(s) 
has Qi{s) as a factor; Qm{s) as in Table 9.5. 



Design 
variables 
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stabilize the actual plant and force j/p to track the reference signal ym = 1 as close 
as possible. As in Example 9.5.1, the parametric model for the actual plant is given 
by 

(9.5.27) 



where z ■ 



s+\ 






hA 



A™ u and A > is chosen 



to satisfy A > Sq/2. A robust adaptive law based on (9.5.27) is 

ep=Pr[T{e4>-crsOp)] (9.5.28) 

where 9p = [6, a]^;Pr(-) is the projection operator that guarantees that \b{t)\ > 
6o > Vf > where bo is a known lower bound for \b\. The other signals used in 
(9.5.28) are defined as 



m' 

,2 I „,2 



1 + n^, nl = nis 



-5oms + Up + yp, m,s{0) = 



(9.5.29) 



and as is the switching cr-modification. Because ym = 1 we have Qm{s) = s and 
select Qi{s) = s + 1, i.e., we assume that 6q < 2. Choosing Kg = [10, 25]^ — [a, 0]^, 
the state-observer is given by 



-o 1 




e + 



bu„ 



-a +10 
25 



([1,0]^ 



eij 



(9.5.30) 



where the poles of the observer, i.e., the eigenvalues of A — KqC, are chosen as 
the roots of Ao{s) = s^ + 10s + 25 = (s + 5)^. The closed-loop poles chosen as 
the roots of j4*(s) = (s -|- 1)^ are used to calculate the controller parameter gain 
Kc{t) = [ki,k2] using 

det(s/ - A + BKc) = {s + if 



which gives 



The control law is given by 



fci 



i-a 



-[ki,k2]e, Up 



(9.5.31) 



The closed-loop plant is described by equations (9.5.26) to (9.5.31) and analyzed 
by using the following steps. 

Step 1. Develop the state error equations for the closed-loop plant. We start 
with the plant equation 



(s -I- a)yp = 6(1 -I- Am{s))up 
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which we rewrite as 



(s + a)syp = 6(1 + A„(s))sUp 
Using syp = sei and filtering each side with Twjy = jrj, we obtain 



{s + a) — —-ei = b{l + A„i)up, Up 
s + 1 



s+1 



which implies that 



Hs + l), . ^ 
ei= ; , \ {1 + A^)up 



s{s + a) 
We consider the following state representation of (9.5.32) 



(9.5.32) 



-a 1 




bu„ 



X-a+l 
A 



ei = [l,0]e + r7, rj 



s + X 



Ajn{s)Up 



(9.5.33) 



Let Co = e — e be the observation error. It follows from (9.5.30), (9.5.33) that Co 
satisfies 



-10 1 
-25 



eo + 


■ 1 ■ 



aei — 


■ 1 ■ 
1 


bup + 



A-9 
A -25 



The plant output is related to e, e^, ei as follows: 

yp = C'^ Co + 0^^6 + 7] + ym, ei=yp-y„ 



T] (9.5.34) 



(9.5.35) 



where C^ = [1,0]. A relationship between Up and e,eo,Ti that involves stable 
transfer functions is developed by using the identity 



s{s + a) (2 -a)s -1-1 
(s + l)2^ (s + l)2 



(9.5.36) 



developed in Section 7.4.3 (see (7.4.37)) under the assumption that b,s(s + a) are 
coprime, i.e., b ^ 0. From (9.5.36), we have 

_ s{s + a) {2- a)s+ 1 

"P - (s+l)2"P + (s+l)2 "P 

Using sUp = {s+l)up = —(s+l)KcS and Up = ^^yp — AmUp in the above equation, 
we obtain 

s + a^ £.1. , [{2-a)s+l]{s + a) [{2 - a)s + l]{s + X) 

-[ki,k2\e-\ ^^^ , .,^3 yp ^^^ , .,^2 v (9.5.37) 



s+1' 



b{s+iy 



6(s + l)2 
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Substituting for Up = —Kc{t)e in (9.5.30) and using C^ e — ei = —C^Co — rj, 
C~^ = [1,0], we obtain 



Ac{t)e- 



where 



AS) 



-a 1 




-a +10 
25 



[ki,k2 



[C^co + r,) 



-1 

-{I -a) 



-1 



(9.5.38) 



(9.5.39) 



Equations (9.5.34) to (9.5.39) are the error equations to be analyzed in the steps to 
follow. 

Step 2. Establish the e.s. of the homogeneous parts of (9.5.34) (^^d (9.5.38). 
The homogeneous part of (9.5.34), i.e.. 



-10 1 
-25 



Y^ = AY^, A = 

is e.s. because det(s/ —A) = {s -\- 5)^. The homogeneous part of (9.5.38) is 
Y = Ac{t)Y where det{sl - Ac{t)) = {s+l^ at each time t. Hence, \{Ac{t)) = -1 

Vt > 0. The adaptive law guarantees that \h(t) | > &o > Vi > and a, h, a, b, ki,ki G 



£00 and a,b,ki e S{rf/m?). Because j^ < 



s+\ 



A 



25a 



A2, it follows that 



||Ac(^)|| e S{/S.l). Applying Theorem 3.4.11(b), we have that Ac{t) is e.s. for 
A2 < A* and some A* > 0. 

Step 3. Use the properties of the C2S norm and B-G lemma to establish sig- 
nal boundedness. Let us denote ||(-)t||2<5 for some 6 G (0, (5o] with ||(-)||. Using 
Lemma 3.3.2 and the properties of the i22(5-norm, we have from (9.5.35), (9.5.37) 
that for ^ < 2 

\\Vp\\<\\C^e,\\+c\\e\\ + M\ + c 

\\uA\<c{\\e\\ + \\yp\\ + M) 
Combining the above inequalities, we establish that the fictitious normalizing signal 
m f = 1 -I- Ik,,"^ 



ll/plP satisfies 



m2<c+c||C^e„f + c||ef + c||r,f 
If we now apply Lemma 3.3.3 to (9.5.38), we obtain 

||e||<c(||C^eo|| + h||) 
and, therefore. 



m 



<c+c||C^eof + c||r,|| 



(9.5.40) 
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To evaluate the term ||C^eo|| in (9.5.40), we use (9.5.34) to write 



s+1 - s (A-9)s + A-25 

(5 + 5)2"'^' (s + 5)2 ^TT"^^ (s + 5)2 



C eo = j^TTT^ae^ - -—-b-—Up + ^-^^^ r; 



Applying the Swapping Lemma A.l and using the fact that sei = sj/p, we have 

C^e. = -^^yp-b^^,u, (9.5.41) 

,- (A-9)s+ (A-25) 
(s + 5)^ 

where Wci{s),Wbi{s) are strictly proper transfer functions with poles at —5. The 
first two terms on the right side of (9.5.41) can be related to the normalized esti- 
mation error. Using z = d*'^ (p + r] we express equation (9.5.29) as 

em^ = e*^ (P + rj - ej (P 

= a — -^Vp-b — -^Up + V (9.5.42) 

We now filter each side of (9.5.42) with f^^c-,2 and apply the Swapping Lemma A.l 
to obtain 

s(s + A) 2 - '5 ' ^ 

+ W, { {Wbyp)d - {WbUp)b} + '^^^V 

where Wc, Wb are strictly proper transfer functions with poles at —5. Using (9.5.43) 
in (9.5.41) we obtain 

C^eo = ^-^^^^em''-W,[{Whypra-{WbUp)b} 



+W,i{Wbiei)a-W,2{Wb2Up)b ttttt^ V 



s2 + 9s + 25 - A 
(s + 5)2 



Using the fact that W(s)yp, W(s)up are bounded from above by m/ for any strictly 
proper VF(s) that is analytic in Re[s] > — | and m < mf, we apply Lemma 3.3.2 
to obtain 

\\C^eo\\ < c\\emmf\\ + c||^m/|| + c\\bmf\\ + c\\rj\\ (9.5.44) 

which together with (9.5.40) imply that 

m^<c+c||5m/f + c||ryf 
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where g^ = \a[ 

we have 
Therefore, for 
we have 



\v\\ 



< 



bA„i{s) 



s + \ 



A 



A. 



rrij: < c+ c\\gmf\\ + cA^m^ 



cA^<l 



mj < c+c||gm/f = c+c I e'^^*-'''' g^{T)mj{T)dT 
Applying B-G Lemma III we obtain 



rrir < ce 



St^cJlg^{r)dr ^ ^^ f* ^-S(t~s) ^c J^ ~g^ {r)dr 



ds 



Because c J g'^{T)dT < cA2{t — s) + c, it follows that for 



cAo < 6 



we have ruf G C^c- The boundedness of all the signals is established as follows: 
Because m < rrif, \\ri\\ < AooWT-/, \ri\ < lS.2m, we have ttt,, ||?7||,?y G Ceo- Applying 
Lemma 3.3.3 to (9.5.38) and (9.5.34), we obtain 



||e||,|e(i)| < cWC-^e^W + cM 
\\eol\eo{t)\ < c||e||+ch||+c||ei|| 
lleill < ||C^eo||+c||e|| + h|| 



(9.5.45) 



From e,m^mf ,\\rj\\,d^h G Coo, it follows from (9.5.44) that ||C^eo|| G Coo and 
therefore using the above inequalities, we have ||e||, |e|, ||eo||, |eo|, ||ei|| G Coo- From 
(9.5.35), (9.5.37) and rj G £00, it follows that Up, Up G £00 which together with 
e = Co + e and e,,, e G £001 we can conclude that all signals are bounded. 
The conditions on Am(s) for robust stability are summarized as follows: 

CA2 < min[cA*, V^], cA^ < 1 



A2 



&A™(s) 



s + A 



A. 



2<5n 



6A„(s) 



s + A 



where A* is a bound for the stability of Ac(t) and < 5 < (5o is a measure of the 
stability margin of Ac{t) and c > represents finite constants that do not affect the 
qualitative nature of the above bounds. 
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Step 4. Establish tracking error bounds. We have, from (9.5.35) that 



ei = C^eo + C^e + -q 

Because (9.5.44), (9.5.45) hold for (5 = 0, it follows that 

ft 



\eit\\l = 



el{r)dT<\\{C'^eMl + 4et\\l + ht\\l 

< 4{9mf)t\\l + c\Ml 

Because m/ G £00, ^ < A2 and \\gt\\2 = Jn g'^{T)dT < A^i + c, we have 



eldr < cA^t + c 



and the stability analysis is complete. 



V 



Let us now extend the results of Example 9.5.2 to the general scheme 
presented in Table 9.6. 

Theorem 9.5.3 Assume that Rp{s,t)Qm{s), Zp(s,t) are strongly coprime 
and consider the APPC scheme of Table 9.6 that is designed for the plant 
model hut applied to the actual plant with A„i, du / 0. There exists constants 
5*, Aj^ > such that for all Am(s) satisfying 

Al + fo<5*, A^<A:, 



where 



A. 



Zp{s) 



Ms) 



Amis] 



A, 



A 



00 (5 



Zp{s) 



Ms) 



Amis] 



2<5n 



and A(s) is an arbitrary polynomial of degree n with roots in RefsJ < —-^, all 
signals in the closed-loop plant are bounded and the tracking error satisfies 



I el(T)dT < c{Al + dl + fo)t + c 
Jo 



where fo = Oin the case of switching a and projection and fo > in the 
case of fixeda (fo = a), e-modification (f^ = vq), and dead zone (fo = go). 

The proof for the input disturbance free (du = 0) case or the case where -^ 
is sufficiently small follows from the proof in the ideal case and in Exam- 
ple 9.5.2. The proof for the general case where -^ is not necessarily small 
involves some additional arguments and the use of the £25 norm over an 
arbitrary time interval and is presented in Section 9.9.2. 
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9.5.5 Robust LQ Adaptive Control 

Robust adaptive LQ control (ALQC) schemes can be formed by combining 
the LQ control law (9.5.5), where Kc is calculated from the Riccati Equation 
(9.5.7), with robust adaptive laws as shown in Table 9.7. 

The ALQC is exactly the same as the one considered in Section 9.5.4 
and shown in Table 9.6 with the exception that the controller gain matrix 
Kc is calculated using the algebraic Riccati equation at each time t instead 
of the pole placement equation of Table 9.6. 

The stability properties of the ALQC scheme of Table 9.7 applied to the 
actual plant are the same as those of APPC scheme based on state feedback 
and are summarized by the following theorem. 

Theorem 9.5.4 Assume that Rp(s,t)Qmis), Zp(s,t) are strongly coprime. 
There exists constants 6*,A'^ > such that for all Amis) satisfying 



Al + fo<d*, Aoo<a:, 



where 



Ar 



A 



A{s) "'^■'' 



A, 



A 



oo5 



Zp{s) 



A{s) 



Amis) 



2<5o 



all signals are bounded and the tracking error e\ satisfies 
f el{T)dT<c{Al + dl + fo)t + c 

JO 
where /o,A(s) are as defined in Theorem 9.5.3. 



Proof The proof is almost identical to that of Theorem 9.5.3. The only difference 
is that the feedback gain Kc is calculated using a different equation. Therefore, if 
we can show that the feedback gain calculated from the Riccati equation guaran- 
tees that ||Ac(0|| G S{^ + /o), then the rest of the proof can be completed by 
following exactly the same steps as in the proof of Theorem 9.5.3. The proof for 

\ 2 

||vlc(i)|| G S{^ + /o) is established by using the same steps as in the proof of Theo- 
rem 7.4.3 to show that ||ic(i)|| < c\\A{t)\\ + c\\B{t)\\. Because ||i(t)||, ||B(t)|| < c\6p\ 
and epeS{^ + /o) we have \\Ac{t)\\ e S{^ + fo). □ 
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Table 9.7 Robust adaptive linear quadratic control scheme 



Actual plant 


yp = tS(i + ^™)K + d„) 


Plant model 


Zp{s) 

yp = Rp{s)Up 


Reference signal 


Qm{s)ym = 


Assumptions 


Same as in Table 9.5 


Robust 
adaptive law 


Same as in Table 9.5 to generate Zp(s,t),Rp(s,t) 
and A, B 


State observer 


Same as in Table 9.6 


Calculation 
of controller 
parameters 


K^ = X-^B'^P 

A^P + pA- {PBB^P + CC^ = 

C^ = [1,0,...,0],P = P^ >0 


Control law 


Up= kcit)e, up= §lup 


Design variables 


A > and Qi, Q„i as in Table 9.6 



Example 9.5.3 Consider the same plant as in Example 9.5.2, i.e. 



Vp 



s + a 



(1 + Ara{s))Up 



and the same control objective that requires the output j/p to track the constant 
reference signal y^ = 1. A robust ALQC scheme can be constructed using Table 9.7 
as follows: 



Adaptive Law 



Op = Pr[r(e0-f7,^p) 
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P ^ 2 1 I 2 2 



Sorris + ul + yp, ms{0) = 



s + X 



Vp, <P-- 



s + \ 



[up,-ypV 



The projection operator Pr[-] constraints h to satisfy \h{i)\ > bo \/t > where 
6o is a known lower bound for |6| and fis is the switching (T-modification. 



State Observer 

where 



k = Ae + Bup - ko{[l 0]e-ei) 



-a 1 




, B = b 



Ko 



10 -a 
25 



Controller Parameters K^, = A ^W P where P = P^ > is solved pointwise 
in time using 

A'^P+pA- PBX-^B^P+CC^ = 0, C^ = [l 0] 



Control Law 



s + 1 _ 
Up = -Kcit)e, Up = Up 



V 



9.6 Adaptive Control of LTV Plants 

One of the main reasons for considering adaptive control in applications is to 
compensate for large variations in the plant parameters. One can argue that 
if the plant model is LTI with unknown parameters a sufficient number of 
tests can be performed off-line to calculate these parameters with sufficient 
accuracy and therefore, there is no need for adaptive control when the plant 
model is LTI. One can also go further and argue that if some nominal values 
of the plant model parameters are known, robust control may be adequate 
as long as perturbations around these nominal values remain within certain 
bounds. And again in this case there is no need for adaptive control. In 
many applications, however, such as aerospace, process control, etc., LTI 
plant models may not be good approximations of the plant due to drastic 
changes in parameter values that may arise due to changes in operating 
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points, partial failure of certain components, wear and tear effects, etc. In 
such applications, linear time varying (LTV) plant models of the form 

X = A{t)x + B{t)u 

y = C^{t)x + D{t)u (9.6.1) 

where A, B, C, and D consist of unknown time varying elements, may be 
necessary. Even though adaptive control was motivated for plants modeled 
by (9.6.1), most of the work on adaptive control until the mid 80's dealt 
with LTI plants. For some time, adaptive control for LTV plants whose 
parameters vary slowly with time was considered to be a trivial extension of 
that for LTI plants. This consideration was based on the intuitive argument 
that an adaptive system designed for an LTI plant should also work for a 
linear plant whose parameters vary slowly with time. This argument was 
later on proved to be invalid. In fact, attempts to apply adaptive control to 
simple LTV plants led to similar unsolved stability and robustness problems 
as in the case of LTI plants with modeling errors. No significant progress was 
made towards the design and analysis of adaptive controllers for LTV plants 
until the mid-1980s when some of the fundamental robustness problems of 
adaptive control for LTI plants were resolved. 

In the early attempts [4, 74], the notion of the PE property of certain 
signals in the adaptive control loop was employed to guarantee the exponen- 
tial stability of the unperturbed error system, which eventually led to the 
local stability of the closed-loop time-varying (TV) plant. Elsewhere, the 
restriction of the type of time variations of the plant parameters also led to 
the conclusion that an adaptive controller could be used in the respective 
environment. More specifically, in [31] the parameter variations were as- 
sumed to be perturbations of some nominal constant parameters, which are 
small in the norm and modeled as a martingale process with bounded covari- 
ance. A treatment of the parameter variations as small TV perturbations, 
in an £2-gain sense, was also considered in [69] for a restrictive class of LTI- 
nominal plants. Special models of parameter variations, such as exponential 
or 1/t-decaying or finite number of jump discontinuities, were considered in 
[70, 138, 181]. The main characteristic of these early studies was that no 
modifications to the adaptive laws were necessary due to either the use of 
PE or the restriction of the parameter variations to a class that introduces 
no persistent modeling error effects in the adaptive control scheme. 
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The adaptive control problem for general LTV plants was initially treated 
as a robustness problem where the effects of slow parameter variations were 
treated as unmodeled perturbations [9, 66, 145, 222]. The same robust adap- 
tive control techniques used for LTI plants in the presence of bounded distur- 
bances and unmodeled dynamics were shown to work for LTV plants when 
their parameters are smooth and vary slowly with time or when they vary 
discontinuously, i.e., experience large jumps in their values but the disconti- 
nuities occur over large intervals of time [225]. 

The robust MRAC and APPC schemes presented in the previous sections 
can be shown to work well with LTV plants whose parameters belong to the 
class of smooth and slowly varying with respect to time or the class with 
infrequent jumps in their values. The difficulty in analyzing these schemes 
with LTV plants has to do with the representations of the plant model. In 
the LTI case the transfer function and related input /output results are used 
to design and analyze adaptive controllers. For an LTV plant, the notion 
of a transfer function and of poles and zeros is no longer applicable which 
makes it difficult to extend the results of the LTI case to the LTV one. This 
difficulty was circumvented in [223, 224, 225, 226] by using the notion of 
the polynomial differential operator and the polynomial integral operator to 
describe an LTV plant such as (9.6.1) in an input-output form that resembles 
a transfer function description. 

The details of these mathematical preliminaries as well as the design 
and analysis of adaptive controllers for LTV plants of the form (9.6.1) are 
presented in a monograph [226] and in a series of papers [223, 224, 225]. 
Interested readers are referred to these papers for further information. 

9.7 Adaptive Control for Multivariable Plants 

The design of adaptive controllers for MIMO plant models is more complex 
than in the SISO case. In the MIMO case we are no longer dealing with a 
single transfer function but with a transfer matrix whose elements are trans- 
fer functions describing the coupling between inputs and outputs. As in the 
SISO case, the design of an adaptive controller for a MIMO plant can be 
accomplished by combining a control law, that meets the control objective 
when the plant parameters are known, with an adaptive law that generates 
estimates for the unknown parameters. The design of the control and adap- 
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tive law, however, requires the development of certain paranieterizations of 
the plant model that are more complex than those in the SISO case. 

In this section we briefly describe several approaches that can be used to 
design adaptive controllers for MIMO plants. 

9.7.1 Decentralized Adaptive Control 

Let us consider the MIMO plant model 

y = H{s)u (9.7.1) 

where y £ 7Z^ , u e IZ^ and H{s) G C^^^ is the plant transfer matrix that 
is assumed to be proper. Equation (9.7.1) may be also expressed as 

yi = hii{s)ui+ ^ hij{s)uj, i = 1,2,...,N (9.7.2) 

l<j<iV 

where hij{s), the elements of H(s), are transfer functions. 

Another less obvious but more general decomposition of (9.7.1) is 

yi = hii{s)ui + ^ {hij{s)uj + qij{s)yj) , i = 1,2,... ,N (9.7.3) 

l<j<Af 

for some diiferent transfer functions hij{s),qij{s). 

If the MIMO plant model (9.7.3) is such that the interconnecting or 
coupling transfer functions hij(s), qij{s) {i / j) are stable and small in some 
sense, then they can be treated as modeling error terms in the control design. 
This means that instead of designing an adaptive controller for the MIMO 
plant (9.7.3), we can design A^ adaptive controllers for N SISO plant models 
of the form 

yi = hii{s)ui, i = l,2,...,N (9.7.4) 

If these adaptive controllers are designed based on robustness considerations, 
then the effect of the small unmodeled interconnections present in the MIMO 
plant will not destroy stability. This approach, known as decentralized adap- 
tive control, has been pursued in [38, 59, 82, 185, 195]. 

The analysis of decentralized adaptive control designed for the plant 
model (9.7.4) but applied to (9.7.3) follows directly from that of robust adap- 
tive control for plants with unmodeled dynamics considered in the previous 
sections and is left as an exercise for the reader. 
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9.7.2 The Command Generator Tracker Approach 

The coniniand generator tracker (CGT) theory was first proposed in [26] for 
the modei foiiowing probiem with known parameters. An adaptive controi 
aigorithni based on the CGT method was subsequentiy deveioped in [207, 
208]. Extensions and further improvements of the adaptive CGT algorithms 
for finite [18, 100] as well as for infinite [233, 234] dimensional plant models 
followed the work of [207, 208]. 

The adaptive CGT algorithms are based on a plant/reference model 
structural matching and on an SPR condition. They are developed using 
the SPR-Lyapunov design approach. 

The plant model under consideration in the CGT approach is in the state 
space form 



X = Ax + Bu 
y = C^x 



x{0) = xo 



(9.7.5) 



where x £ TZ"^; y,u ^ TZ"^; and A,B, and C are constant matrices of appro- 
priate dimensions. The control objective is to choose u so that all signals in 
the closed-loop plant are bounded and the plant output y tracks the output 
ym of the reference model described by 



Vm 



+ BmV XmiO) = XmO 



'^m-^rn 



(9.7.6) 



where Xm e 7^'^",r e W"' and ym e TV^. 

The only requirement on the reference model at this point is that its 
output ym has the same dimension as the plant output. The dimension of 
Xm can be much lower than that of x. 

Let us first consider the case where the plant parameters A,B, and C 
are known and use the following assumption. 



Assumption 1 (CGT matching condition) There exist matrices S\i, 
5J°2, <S'2i, 5*22 such that the desired plant input u* that meets the control 
objective satisfies 



X 

u* 



5* Q* 

11 '-'12 

'-'21 '-'22 



(9.7.7) 
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where x* is equal to x when u = u* , i.e., x* satisfies 

X* = Ax* + Bu* 

y = C X =ym 

Assumption 2 (Output stabilizability condition) There exists a ma- 
trix G* such that A + BG*C is a stable matrix. 

If assumptions 1, 2 are satisfied we can use the control law 

u = G*{y-yra) + Sl^Xm + Sl^r (9.7.8) 

that yields the closed-loop plant 

x = Ax + BG*ei + BS^iXm + BSl2r 

where ei = y — ym- Let e = x — x* be the state error between the actual and 
desired plant state. Note the e is not available for measurement and is used 
only for analysis. The error e satisfies the equation 

e = {A + BG*C'^)e 

which implies that e and therefore ei are bounded and converge to zero 
exponentially fast. If Xm,r are also bounded then we can conclude that all 
signals are bounded and the control law (9.7.8) meets the control objective 
exactly. 

If A,B, and C are unknown, the matrices G*,S'2i, and 5*22 cannot be 
calculated, and, therefore, (9.7.8) cannot be implemented. In this case we 
use the control law 

u = G{t){y - ym) + S2x{t)xm + 522(t)r (9.7.9) 

where G(t), S2i(t), S22it) are the estimates of G* , S21, S22 to be generated 
by an adaptive law. The adaptive law is developed using the SPR-Lyapunov 
design approach and employs the following assumption. 

Assumption 3 (SPR condition) There exists a matrix G* such that 
C^{sl -A- BG*G^)-^B is an SPR transfer matrix. 
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Assumption 3 puts a stronger condition on the output feedback gain 
G* , i.e., in addition to making A + BG*C stable it should also make the 
closed-loop plant transfer matrix SPR. 

For the closed-loop plant (9.7.5), (9.7.9), the equation tor e = x — x* 
becomes 

e = {A + BG*C^)e + BGei + BSLO 
ei = C^e (9.7.10) 



where 



G{t) = G{t) - G* , S{t) = S{t)-S* 

Sit) = [S2lit),S22m S* = [S*2„S*22] 

We propose the Lyapunov-like function 

V = e^Pce + tr[G^T^^G] + tr[S'^T^^S] 

where Pc = Pj > satisfies the equations of the matrix form of the LKY 
Lemma (see Lemma 3.5.4) because of assumption 3, and ri,r2 are symmet- 
ric positive definite matrices. 
Choosing 

G = G = -rieie7 

§ = S = -r2eiuj'^ (9.7.11) 

it follows as in the SISO case that 

V = -e^QQ^e - Vce^ L^e 

where L^ = LJ > and t'c > is a small constant and Q is a constant matrix. 
Using similar arguments as in the SISO case we can establish that e, G, S 
are bounded and e £ £2- If in addition Xm,?" are bounded we can establish 
that all signals are bounded and e, ei converge to zero as t ^ 00. Therefore 
the adaptive control law (9.7.9), (9.7.11) meets the control objective. 

Due to the restrictive nature of Assumptions 1 to 3, the CGT approach 
did not receive as much attention as other adaptive control methods. As 
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shown in [233, 234], the CGT matching condition puts strong conditions on 
the plant and model that are difficult to satisfy when the reference signal r is 
allowed to be bounded but otherwise arbitrary. If r is restricted to be equal 
to a constant these conditions become weaker and easier to satisfy. The class 
of plants that becomes SPR by output feedback is also very restrictive. In 
an effort to expand this class of plants and therefore relax assumption 3, 
the plant is augmented with parallel dynamics [18, 100], i.e., the augmented 
plant is described by 



Va 



[C^isI-A)-^B + Wais)]u 



where Wa{s) represents the parallel dynamics. If Wa{s) is chosen so that 
assumptions 1, 2, 3 are satisfied by the augmented plant, then we can estab- 
lish signal boundedness and convergence of ya to y^- Because ya i^ y the 
convergence of the true tracking error to zero cannot be guaranteed. 

One of the advantages of the adaptive control schemes based on the CGT 
approach is that they are simple to design and analyze. 

The robustness of the adaptive CGT based schemes with respect to 
bounded disturbances and unmodeled dynamics can be established using the 
same modifications and analysis as in the case of MRAC with unnormalized 
adaptive laws and is left as an exercise for the reader. 

9.7.3 Multivariable MRAC 

In this section we discuss the extension of some of the MRAC schemes for 
SISO plants developed in Chapter 6 to the MIMO plant model 

y = G{s)u (9.7.12) 

where y e TZ , u £ 7Z and G{s) is an N x N transfer matrix. The reference 
model to be matched by the closed-loop plant is given by 

Vm = Wm{s)r (9.7.13) 

where y-rm^ G TZ^ . Because G{s) is not a scalar transfer function, the 
multivariable counterparts of high frequence gain, relative degree, zeros and 
order need to be developed. The following Lemma is used to define the 
counterpart of the high frequency gain and relative degree for MIMO plants. 



Cm{s) 
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Lemma 9.7.1 For any Nx N strictly proper rational full rank transfer ma- 
trix G(s), there exists a (non-unique) lower triangular polynomial matrix 
S,mis), defined as the modified left interactor (MLI) matrix of G{s), of the 
form 

di{s) ••• 

/i2i(s) d2{s) ••• 

: ■•• 

hNl{s) ^Ar{Ar-l)(s) dN{s) 

where hij{s),j = 1, . . . , N — l,i = 2, . . . , N are some polynomials and di{s), 
i = 1, . . ., iV, are arbitrary monic Hurwitz polynomials of certain degree 
li > 0, such that linis^oo ^mis)G{s) = Kp, the high-frequency-gain matrix of 
G(s), is finite and nonsingular. 

For a proof of Lemma 9.7.1, see [216]. 

A similar concept to that of the left interactor matrix, which was intro- 
duced in [228] for a discrete-time plant is the modified right interactor (MRI) 
matrix used in [216] for the design of MRAC for MIMO plants. 

To meet the control objective we make the following assumptions about 
the plant: 

Al. G(s) is strictly proper, has full rank and a known MLI matrix ^m(-s)- 

A2. All zeros of G(s) are stable. 

A3. An upper bound i>o on the observability index l^q of G{s) is known 
[50, 51, 73, 172]. 

A4. A matrix Sp that satisfies KpSp = {KpSp) > is known. 

Furthermore we assume that the transfer matrix Wm{s) of the reference 
model is designed to satisfy the following assumptions: 

Ml. All poles and zeros of Wm{s) are stable. 

M2. The zero structure at infinity of Wm{s) is the same as that of G{s), 
i.e., Wvus^oc, ^m{s)Wm{s) is finite and nonsingular. Without loss of 
generality we can choose Wm{s) = i^{s). 
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Assumptions Al to A4, and Ml and M2 are the extensions of the as- 
sumptions PI to P4, and Ml and M2 in the SISO case to the MIMO one. 
The knowledge of the interactor matrix is equivalent to the knowledge of 
the relative degree in the SISO case. Similarly the knowledge of Sp in A4 is 
equivalent to the knowledge of the sign of the high frequency gain. 

The a priori knowledge about G(s) which is necessary for ^m(s) to be 
known is very crucial in adaptive control because the parameters of G(s) 
are considered to be unknown. It can be verified that if ^mis) is diagonal 
and the relative degree of each element of G(s) is known then ^m(s) can be 
completely specified without any apriori knowledge about the parameters of 
G(s). When ^^(•s) is not diagonal, it is shown in [172, 205] that a diag- 
onal stable dynamic pre-compensator Wp(s) can be found, using only the 
knowledge of the relative degree for each element of G(s), such that for most 
cases G(s)Wp(s) has a diagonal ^mis). In another approach shown in [216] 
one could check both the MLI and MRI matrices and choose the one that is 
diagonal, if any, before proceeding with the search for a compensator. The 
design of MRAC using the MRI is very similar to that using the MLI that 
is presented below. 

We can design a MRAC scheme for the plant (9.7.12) by using the cer- 
tainty equivalence approach as we did in the SISO case. We start by as- 
suming that all the parameters of G(s) are known and propose the control 
law 

u = efiJi + efi02 + eir = r^w (9.7.14) 

where 0*^ = [6f,6f,6l], to = [u:J ,uj ,r'^]' . 

A{s) A{s) 

A(s) A(s) 

0* r/j* /)* iT /)* In* Q* iT 

Ul - [^11, ..., UipJ , ^2 - [fc'211 • • • ' c'2PoJ 

0|,0*,•e7^^^^, i = l,2, i = l,2,...,i>o 

and A(s) is a monic Hurwitz polynomial of degree z^q. 

It can be shown [216] that the closed-loop plant transfer matrix from y 
to r is equal to Wmis) provided 0^ = K~^ and 9\,92 are chosen to satisfy 
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the matching equation 

^~^'^W)~ ^*''W)^^'^ ^ e*,W-\s)G{s) (9.7.15) 

The same approach as in the SISO case can be used to show that the control 
law (9.7.14) with 6*,i = 1,2,3 as chosen above guarantees that all closed- 
loop signals are bounded and the elements of the tracking error ei = y — Vm 
converge to zero exponentially fast. 

Because the parameters of G{s) are unknown, instead of (9.7.14) we use 
the control law 

u = e'^{t)uj (9.7.16) 

where 9{t) is the on-line estimate of the matrix 6* to be generated by an 
adaptive law. The adaptive law is developed by first obtaining an appro- 
priate parametric model for 9* and then using a similar procedure as in 
Chapter 4 to design the adaptive law. 

From the plant and matching equations (9.7.12), (9.7.15) we obtain 

ei-\u - r^a;) = W-\s){y - y^) = U{s)ei (9.7.17) 

Let dm be the maximum degree of ,^„i(s) and choose a Hurwitz polynomial 
f{s) of degree dm- Filtering each side of (9.7.17) with l//(s) we obtain 

z = tp*[0*^<j) + zo] (9.7.18) 

where 



' fis) 



ei, r = 0*3~^ = Kp 



1 1 

-OJ, Zq = ~ Pt \ U 



which is the multivariable version of the bilinear parametric model for SISO 
plants considered in Chapter 4. 

Following the procedure of Chapter 4 we generate the estimated value 
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of z and the normalized estimation error 

z — z 



m? 



We can verify that 

where ^ = zq + 0^ (f) and m? could be chosen as m? = 1 + |^|^ + \4>\'^. The 
adaptive law for 9 can now be developed by using the Lyapunov-like function 

V = ^tr[9'^Tpe] + Ur[4^'^r-^] 

where Tp = KJ Sp^ = {S-^^ {KpSp^ Sp^ and T = T^ > 0. If we choose 

e'^ = -Sptcf^ , i) = -reC^ (9.7.19) 

it follows that 

V = -^ tn? < 

which implies that 9,^p are bounded and \em\ G £2- 

The stability properties of the MRAC (9.7.12), (9.7.16), (9.7.19) are sim- 
ilar to those in the SISO case and can be established following exactly the 
same procedure as in the SISO case. The reader is referred to [216] for the 
stability proofs and properties of (9.7.12), (9.7.16), (9.7.19). 

The multivariable MRAC scheme (9.7.12), (9.7.16), (9.7.19) can be made 
robust by choosing the normalizing signal as 

771 = 1 + rris, rhs = —SoTTis + \u\ + \y\ ,ms{0) = (9.7.20) 

where (5o > is designed as in the SISO case and by modifying the adaptive 
laws (9.7.19) using exactly the same techniques as in Chapter 8 for the SISO 
case. 

For further information on the design and analysis of adaptive controllers 
for MIMO plants, the reader is referred to [43, 50, 51, 73, 151, 154, 172, 201, 
205, 213, 214, 216, 218, 228]. 
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9.8 Stability Proofs of Robust MRAC Schemes 

9.8.1 Properties of Fictitious Normalizing Signal 

As in Chapter 6, the stabihty analysis of the robust MRAC schemes involves the 
use of the C25 norm and its properties as well as the properties of the signal 

m}^l + \\u,f+\\y,f (9.8.1) 

where ||(-)|| denotes the C2S norm ||(-)t||2(5. The signal nif has the property of 
bounding from above almost all the signals in the closed-loop plant. In this, book, 
ruf is used for analysis only and is referred to as the fictitious normalizing signal, to 
be distinguished from the normalizing signal m used in the adaptive law. For the 
MRAC law presented in Table 9.1, the properties of the signal nif are given by the 
following Lemma. These properties are independent of the adaptive law employed. 

Lemma 9.8.1 Consider the MRAC scheme of Table 9.1. For any given 5 e (0, 5q\, 
the signal nif given by (9.8.1) guarantees that: 

(i) M M i= 12 and ^ eCoo- 

(ii) If0 e Coo, then ^, f^, ^, ^, t^,MA(.c^ ^here Wis) is any proper 
transfer function that is analytic in Re[s] > —So/2. 

(iii) If 6, r e Coo, then |^ G £00- 



(iv) For 6 = 6t), (i) to (iii) are satisfied by replacing nif with m = -^/T+nf, where 
n1 = Wis and rhs = —60ms + Up + y"^, ms{0) = 0. 

Proof (i) We have 

a{s) a{s) 

Because the elements of ^W are strictly proper and analytic in Re[s] > —So/2, it 
follows from Lemma 3.3.2 that ^-^i^, li^ (= Coot^ =1,2 for any S G (0,(5o]. Now 
ll^ll ^ ll^ill + 11^211 + ll^pll + c < cnif + c and therefore ^^ G C^o- Because 
nl=ms= \\upt\\lg^ + |bpt||25„ and ||(-)t||25o < \\{-)ths for any S G (0,(5o], it follows 
that Us/ nif G Co 

Mp 



(ii) From equation (9.3.63) and Up = 6^ lo we have 



Vp = Wm[s)p*e^u} + p*^ + w„Xs)r 

where r] = — -^ — Wm[A„j(up + rf„) + dy\. Because Wm^ W„iA„i are strictly proper 
and analytic in Re[s] > —6o/2, and 9 G £00, it follows that for any S G (0, Sq] 

\yp{t)\ < c\\uj\\ + c\\up\\ +c< cnif + c 
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i.e., yp/nif G Coo- Since uj = [ujj ,ujj ,yp,r]^ and r^LUi/nif^i =1,2 and yp/nif G 
Coo, it follows that uj/irif e Coo- From Up = 9^ lo and 6. ^^, -1^ G Coo, we 
have ^,^ e £00. We have \W{s)uj\ < \\Wais)\\2sM + \d\M < cruf where 
W()(s) -\- d = Wis) and, therefore, — ^^^ G .Coo- The signal y^ is given by 

ijp = sWm{s)r + sWm{s)p*0^uj + p*77 
Because sWm{s) is at most biproper we have 

\\yp\\<c\\sWUs)\\oo8M\ + cM + c 



where 



< 



^-'""(^Uw^„(.)A„(.) 



A(.) 
< cnif + cdf) 



cdn 



00 (5 



WvA 



which together with - — - G £00 imply that ^^^ G £00 • 



are 



(iii) We have Co = [ X(si "P' Ms) Vp^ Vpt"^]^ ■ Because the elements of ^^^ 
proper and analytic in Re[s] > — 5o/2 and r, -i^^^ G £00, it follows that -^^ G Coo- 

(iv) For (5 = (Jo we have mj = 1 + \\upt\\ls^ + ||ypt|l25o- Because m^ = 1 + 
IkptllLo + II ^/pt II 25,, = "^/' ^^'^ P™°^ °^ (i^) follows. D 



m,(0) = 



(9.8.2) 



Lemma 


9.8.2 


Consider the 


systems 
V = 


--H{s)v 


p 




and 


















nis = 


-Sonis + 


Kl' + 


K 


2 






m" = 


1 + nis 









where Sq > 0, ||t'pt||25o — cm{t) \/t > and some constant c > and H{s) is a 
proper transfer function with stable poles. 

Assume that either \\vt\\2s„ < cm{t) Vt > for some constant c > or H{s) is 
analytic in Re[s] > —Sq/^. Then there exists a constant 6 > such that 

(i) lkMJI<ce-t(*-*0^(t^)+||/7(,)||^,||^^^^J|, Vi>ti>0 
(ii) // H{s) is strictly proper, then 

Ht)\ < ce-t(*-*^)m(ii) + \\H{s)\\2s\\vp,,J, Vi > ti > 
where ||(-)i,till denotes the C25 norm over the interval [ti,t) 
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Proof Let us represent (9.8.2) in the minimal state space form 

X = Ax+ Bvp, x{0) = 

V = C'^x + Dv.p (9.8.3) 

Because A is a stable matrix, we have ||e^*^'^'|| < Aoe"""^*^'^-' for some Aq, ao > 0. 
Applying Lemma 3.3.5 to (9.8.3) we obtain 

\WtA\<ce-i'^'-'^Mti)\ + \\H{s)\UW,^\\ (9.8.4) 

and for -ff (s) strictly proper 

1^(^)1 < ce-t(*-*^)|x(ii)| + \\H[s)hs\\vp,^., II (9.8.5) 

for any Q < 5 < 2aQ and for some constant c > 0. If _ff(s) is analytic in Re[s\ > 

So 
2 

\x{t)\ < cWvpthso < cm{t) Vt>0 



-So/2 then A — ^ J is a stable matrix and from Lemma 3.3.3 we have 



Hence, |a;(ii)| < cm{ti), (i) and (ii) follow from (9.8.4) and (9.8.5), respectively. 

When H{s) is not analytic in Re[s] > — (5o/2 we use output injection to rewrite 
(9.8.3) as 

x={A- KC^)x + Bvp + KC^x 

or 

X = AcX + BcVp + Kv (9.8.6) 

where Ac = A — KC^ , Bc = B — KD and K is chosen so that Ac — ^/ is a stable 
matrix. The existence of such a iiT is guaranteed by the observability of [C, A) [95]. 
Applying Lemma 3.3.3 (i) to (9.8.6), we obtain 

\x{t)\<c\\vpt\\25o + c\\vt\\25„<cm{t) Vt>0 (9.8.7) 

where the last inequality is established by using the assumption ||wt||2(5oj ll^'ptlb*,, ^ 
cm[t) of the Lemma. Hence, ||x(ti)|| < cm{ti) and (i), (ii) follow directly from 
(9.8.4), (9.8.5). D 

Instead of nif given by (9.8.1), let us consider the signal 

m2^(i)^e-^(*-*^)m2(fi)+||«p.,,f +||yp,.JP, t>h>Q (9.8.8) 

The signal nif\ has very similar normalizing properties as m/ as indicated by the 
following lemma: 

Lemma 9.8.3 The signal ruf^ given by (9.8.8) guarantees that 
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(i) Ljj(t)/m/^,i = 1,2; ||cjt,ij|/m/j and ris/mf^ e Ceo 

(ii) If 9 e Coo, thenyp/ruf^, Up/ruf^, uj/ruf^, W{s)uj/mf^ e Coo and \\up^^J\/mf^, 

WVpt.tJ/^fi e/^oo 
(iii) IfO,re Coo, then \\LUt.tA\/mf^ e Coo 

where ||(-)i,till denotes the C25-norm defined over the interval [ti,t],t > ti > 0; S is 
any constant in the interval (0, i5o] and W{s) is a proper transfer function, which is 
analytic in Re[s] > —5o/2. 



Proof (i) We have uji = -rj4up,(jj2 = xfrJ/p- Since each element of -rj4 is strictly 

2 



proper and analytic in Re[s] > — -^ and ||Mj,t||2(5oi llj/ptlbtJo ^ cttt., it follows from 



Lemma 9.8.2 that 

|wi(i)l, 11^1.,., II < ce-3(*-*i)m(ii) + c||up.,.^ || < cmj^ 

\Mt)l 11^2,,., II < ce-f (*-*i)m(ti) + c||2/p. .^ || < cm/, 
and, therefore, |ct;i(t)|, \\LUi^ ^ ||,i = 1,2 are bounded from above by mf^. Because 

I^M. f < ll'^iM. f + 11^2.,, f + ||yp..., f + c < cml 
therefore, \\ujt,ti \\ is bounded from above by mf^. We have n^ = wis = rn^ — 1 and 

nl = mS) = e-'"^'-'^Hm\t,) - 1) + ||«,.,^ H^,^, + |bp.^.^ ||^,^, 
< e-^(*'*^)m2(ti)+|k,,,,f + ||2/p.,,f = m2^ 

for any given 6 G (0, Sq], and the proof of (i) is complete, 
(ii) We have 

Vp = W„i{s)p*0'^uj + p*r] + Wm{s)r 

Because Wm{s) is strictly proper and analytic in Re[s] > —So/2, and Lemma 9.8.1 
together with G Coo imply that ||/3*^^Wt||25o ^ cm{t) \/t > 0, it follows from 
Lemma 9.8.2 that 

\yp{t)l Ibp..., II < ce^f (*-*i)m(ii) + c\\^t,t, II + c\\r]t,t, || + c, Vt > ii > 

Now rj = A{s)up + djj where A(s) is strictly proper and a nalytic in Re[s] > — -j-, 
rfjj G Coo and ||up, ||25o ^ m{t). Hence from Lemma 9.8.2 we have 

ht.tJI < ce-t(*-*i)m(ii) + c||«p. .Jl + c 

Because Up = 9^ lo and 9 G Coo, we have ||up(( || < c||ajt.tj|, and from part (i) we 

have IJtJt.iJI < cmf\. Therefore H^ptt || < cm/, , ||?yt,ti|| < ce^s (*^*i)j7i(ij^)+cm/j+c 
and 

\yp{t)\, Wvp,,^ II < ce-3(*-*i)m(ii) + cnif^ +c< cnif. 
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In a similar manner, we show ||2/p, , || < cnif^. From \Lo{t)\ < \LUi{t)\ + \LU2{t)\ + 
|j/p(t)| + c, it follows that \uj{t)\ < cruf-^. Because Up = 0^ uj and 9 G Coo, it follows 
directly that |up(i)| < cruf-^. 

Consider v = W{s)ll! where VF(s) is proper and analytic in Re[s] > —Sq/2. 
Because from Lemma 9.8.1 ||tiJt||2(So ^ cm{t), it follows from Lemma 9.8.2 that 

\v{t)\ < ce-i(*-*i)m(fi) + c\\LUt,tA\ < cruf^ 



(iii) We have Co = \ioJ ,lu2 tVptT]^ , where Coi 



sa{s) 



^M 



K(s) "P' 



Up,UJ2 



scx(s) 



Up. Because 



the elements of ^^t^ are proper, it follows from the results of (i), (ii) that Wioi^ ^ \\ 
cmf-^,i = 1,2 which together with r G £00 and ||yp, ^ || < cruf^ imply (iii). 



9.8.2 Proof of Theorem 9.3.2 

We complete the proof of Theorem 9.3.2 in five steps outlined in Section 9.3. 

Stepl. Express the plant input and output in terms of the parameter error term 
O^uj. We use Figure 9.3 to express Up,yp in terms of the parameter error 9 and 
modeling error input. We have 

GqAcS 



Vp 



(A -CD- GoDl 



-¥, 



k-Cl 



-Vi 



Vl = ^m{s){Up + du) + du 



ACn 



{A-Cl)-GoDl 



1 ;.-, 



GoDl 



(A -at)- GoDl 



Vl 



where Gl{s) = dl^a{s),Dl = 9'^A{s) + 02^q:(s). Using the matching equation 

GoAcg 



(A - Q) - GoDl 



W„ 



we obtain 



Vp 



W„ 



r + —9"^Uii j + r^y 
^0 



Go^W^ 



1 7.- 



T. 



(9.8.9) 



where 



Vu 



9lk + 9*^a^^^ K-9fa^^^ 

-VF„,?7i, 'qy = -^^ W^rji 



c*oA 



c*oA 
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Let us simplify the notation by denoting ||(-)t||2(S with 



From (9.8.9) and 



the stability of Wm, Gq Wm, we obtain 

||yp||<c + c||0'^c.|| + 11,7,11, \\up\\<c + c\\e'^uj\\ + \\rj^\\ (9.8.10) 

for some (5 > by applying Lemma 3.3.2. Using the expressions for riu,riy, we have 
A{s) - ei'^ a{s) 



ll%ll < 



h«ll < 



c*A(s) 



||W^„(s)A„(s)||oo5||wp|| + cdo 



CO (5 



0*,A{s) 



a{s) 



c*A(s) 



||W,„(s)A„j(s)||oo5||wp|| + cdo 



oo5 



where rfg is the upper bound for d^ and c > denotes any finite constant, which 
implies that 

WVyW < cAoomf + cdo, \\riu\\ < cAoo?w/ + cdo (9.8.11) 



A 



where Aoo = || W„(s)A„i(s)||oo5- From (9.8.10) and (9.8.11), it follows that the 



fictitious normalizing signal m'i 



A 



WpW 



satisfies 



m} < c+c||Fwf + cA^m^ 



(9.8.12) 



r. 



Step 2. Use the swapping lemmas and properties of the C2S-norm to hound 
^^ LoW from above. Using the Swapping Lemma A. 2 from Appendix A, we express 



Fuj = Fi{s,aQ){e uj + e'^i:j) + F{s,ao)d'^uj 



(9.8.13) 



where F{s, ao) 



,Fi{s,ao) = v''""'^ , ao is an arbitrary constant to be 



(s+a„)>' 

chosen, k > n* and n* is the relative degree of Go{s) and Wm{s). Using Swapping 
Lemma A.l, we have 



e^uj = w-\s) \e^w{s)Lj + Wc{WbCJ^ 



(9.8.14) 



where VF(s) is any strictly proper transfer function with the property that W{s), 
W^^{s) are analytic in Re[s] > —Sq/2. The transfer matrices Wc{s), Wb{s) are 
strictly proper and have the same poles as W{s). Substituting for O'^uj given by 
(9.8.14) to the right hand side of (9.8.13), we obtain 



uj = Fi[e uj + e'uj] + Fw-'^ie ' Wuj + wdWbUj ' )e] 



(9.8.15) 



where FW^^ can be made proper by choosing W{s) appropriately. 

We now use equations (9.8.13) to (9.8.15) together with the properties of the ro- 
bust adaptive laws to obtain an upper bound for ||^^aj||. We consider each adaptive 
law of Tables 9.2 to 9.4 separately as follows: 
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Robust Adaptive Law of Table 9.2 We have 



3/ - e/ - WmLenl = WmL[p*e^ (j> - p(, - enj + p*f]f] 



therefore, 



0'^0 = - (W^„^L-^e + pi + enl) - ry^ 



(9.8.16) 



where = L^{s)uj , Lo{s) = ^-^(s)^^. Choosing W{s) = Lo{s) in (9.8.15) we 



obtain 



uj = Fi[0 Lu + e'u] + FL-'^ie ' Louj + WciWbLU ' )0] 

I ho 

' s+h„ ' 



Substituting for 6*^0 = d'^ LqllJ and La{s) = L"i(s)^q^, and using (9.8.16), we 
obtain 



Fi[e uj + e'^ilj] 

FW-rl±^e + FL^^ 
Hqp 



K + <^ni 



77/ + WciWbLo'^ye 



Substituting for ^ = Uf - 6*^0 = LqO'^ uj - 0'^ Lo(j) = Wc{WbUj'^)0, where the last 
equality is obtained by applying Swapping Lemma A.l to Lq{s)0^ijJ, we obtain 



Fi[0 



^ rcO] + Fiy-if±^e + FLq-i ''^^ 



. * ^ ■ ^ "u ^ - ^/ + ^W,iWbiu'^)0 
hop* I P* P* 

(9.8.17) 
Choosing fc = n* + 1 in the expression for F{s,ao), it follows that FW^^{s + ho) 
is biproper, FLq = FL ^'^ ° is strictly proper and both are analytic in Re[s\ > 
—6o/2. Using the properties of F, Fi given by Swapping Lemma A. 2, and noting 
that ll(i+s^^W^™Hs)lloo5 and \\^-^^L{s)\\^s are finite constants, we 
have 



\Fi{s,ao)\\ooS < 



c 

ao' 



F{s,ao)W-\sf-±^ 



< ca, 







\\F{s,ao)L^\s) 



I oo(5 



F{s,ao)L{s) 



s + hn 



ho 



< can 



(9.8.18) 



for any S G (0, 5q]. 

We can use (9.8.17), (9.8.18) and the properties of the C25 norm given by 
Lemma 3.3.2 to derive the inequality 



5^c.|| < — ( 

"0 



u,\\ + \\0-^d;\\) + ca',\\e\\+ca^,\\enl\ 



-ca'^\\W,{Wbu;'^)0\\ + \\FL^'rjj\\ 



(9.8.19) 
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From Lemma 9.8.1 and 6 G C^o, we have 

W ||w|| WbU)'^ Us 



eCc 



nif nif iTif nif 

WW^iWtLU-^M < c\\emfl p-^d^W < cnif, \\enl\\ < ||m,m/|| 
Furthermore, 

\\FL^%]\ = llFryoll = H^W^-^H < \\F{s)W-\s)\U\\v\\ < c^M 
where 



and 



\V\\ < 



A(.) 
A(s) - ei'^a{s) 



< clS.rxi'mf + cdo 



||W„(s)A„(s)||oo5||wp|| + cdo 



ooS 



Hence, 



and (9.8.19) may be rewritten as 

\\e'^uj\\ < —\\emf\\ + —ruf + ca'^iWen^mfW + ||em/|| + ||^m/||) + ca^A^mf + cdo 
ao ao 

(9.8.20) 
where c > denotes any finite constant and for ease of presentation, we use the 
inequality ||e|| < ||e?TT-/|| in order to simplify the calculations. We can also express 
(9.8.20) in the compact form 



^11 < c||5m/|| + c ( h agAoo ) mj + cdo 



(9.8.21) 



where g"^ = ^-^ + al''{\ens\^ + \e\^ + e^). Since e,ens,9 e S{fo+^), it follows that 
g & S{fo+ :^). Because 

A(s) -efa{s) 1 ho 



we have 
where 



Vf = ' ' ,,\ —L (s) — ——[A^{s){up + du) + d^ 

A(s) s + ho 



\Vfit)\ <Aa2m{t) + cdo 
A A(s) -ei^a{s) 1 ho 



A 



02 



A(s) 



s + ho 



(9.8.22) 



2So 
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Hence, in (9.8.21), g e S{fo + A^^ + ^). 

Robust Adaptive Law of Table 9.3 This adaptive law follows directly from that 
of Table 9.2 by taking L^^{s) = Wm{s),Lf){s) = Wm{s) and by replacing jq^ by 
unity. We can therefore go directly to equation (9.8.17) and obtain 



9^uj = Fi{9 uj + 6^ Co) + =^e + FW~^ 



en 



+ —WAWbUJ^)e-'q 

p' p* 



where 



A(s) 



The value of k in the expression for F[s^ ao) can be taken as fc = n* (even though 
k = n* -\- 1 will also work) leading to FW~^ being biproper. 

Following the same procedure as in the case of the adaptive law of Table 9.2, 
we obtain 



-^11 < -^p u,\\ + \\e'^d;\\) + caUe\\+ca^Jenl\\ 

"0 



+ ca^\\Wc{WbUj'^) 
which may be rewritten in the form 



\FW~M\ 



uj\\ < c\\gmf\\ + c ( h apAoo ) rrif + cdo 



(9.8.23) 



where ^2 = l^ + al''{\ens\^ + le]"^ + e^). Because e, en,, 6* G 5(/o ■ 

2 

that 5 e 5(/o + i). Because 



where 



A. 



\ri{t)\ < A2m{t) + cdo 
A(s) - 9fa{s) 



A(s) 



W„(s)A„(s) 



2<5o 



it follows that in (9.8.23) g e S{fo + A^ 



-^), it follows 



(9.8.24) 



V, i-e-, 



Robust Adaptive Law of Table 9.4 We have ern^ = z — z = —O^c 

9^ (j)p = —rj — em? . We need to relate 9^ (t>p with 9^ lo. Consider the identities 

0^(j)p = 0j(j)D + coj/p, 9^uj = e]^ujn + Cor 

where 610 = [6'^, 6'J, 6*3]^, ujq = [ujj ,uj^ ^yp]^ and 0o = Wm{s)ijJo- Using the above 
equations, we obtain 



0^cj)D = 9^ (t)p - coVp = -eTv? - coyp - rj 



(9.8.25) 
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Let us now use the Swapping Lemma A.l to write 

Wm{s)0'^io = 9jWm{s)LUo + c^V^ + W,{Wt,uj'^)e 
Because 6^ (f)Q = 9^Wm{s)ijJQ, it follows from above and (9.8.25) that 

W„(s)Fu; = -em^ - c^Vp - r; + 5o2/m + Wc{WbUJ^)e (9.8.26) 

Substituting for 

Vp = ym+ —Wm{s)6^UJ + Tjy 

in (9.8.26) and using rj = c^rfy, where 

"Iv = *A/\ Wm{s)[A^{s){up + du) + du] 

we obtain 

Wm{s)¥uj = -em^ - ^W^„(s)6i^cj + Wc{WbOJ^)e - c^riy 

Because 1 + % = % and — e C^, , we have 

W„(s)Ftj = ^ [-em^ + PFc(VFfcCj^)^ - cot^J (9.8.27) 

Co L J 

Rewriting (9.8.13) as 

. -T _ 

e^uj = Fi{e uj + e'^uj) + Fw;;,^{Wrae'^uj) 

and substituting for Wm{s)d^ uj from (9.8.27), we obtain 

e^uj = Fi{e io + e'^uj) 

+ FW;;,^^\-em^ + We{Wbiu'^)d-cor]y] (9.8.28) 

Co L J 

Following the same approach as with the adaptive law of Table 9.3, we obtain 

ll^^^ll < c\\gmf\\ +c( — + a^Aoo ) mj + cdo (9.8.29) 

^heregeS{fo+^)orgeS{fo + Al + §)s.ndg^=^-^ + af{\en^\ + \0\^ + e^). 

Step 3. Use the B-G Lemma to establish boundedness. The bound for ||p ti;|| 
in (9.8.21), (9.8.23), and (9.8.29) has exactly the same form for all three adaptive 
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laws given in Tables 9.2 to 9.4. Substituting for the bound of ||^^cli|| in (9.8.12) we 
obtain 

'"-/ ^ '-■~<~ '--iiy'"'/ii ~<~ '-- 1 — 2 "'" '^ 
For 



mj < c+c\\gmf\\^ + c[ — + a;5*=A^ nij + cd^ 



c[\+al''Al] <1 (9.8.30) 

^0 



we have 



mj < Co + c||gm/|p 
where cq depends on dg, which may be rewritten as 



Jo 



Applying the B-G Lemma III, we obtain 

ft 



m^ < ce-*v/<>'(^)'*^ + co<5 ['e-^^'-^^e^H ^"^^^''^ds 



Because g G S{fo + Af-\ — |-) where A^ = A02 for the SPR-Lyapunov based adaptive 
law and A^ = A2 for the adaptive laws of Tables 9.2 and 9.4, we obtain 

m^f < ce-t'e'/o' ^''^ + co5 f e-f(*-^)e^X' A'^rfs (9.8.31) 



Jo 
provided 

c(/o + A^) < ^ (9.8.32) 

where c in (9.8.32) is proportional to ^ + OfQ*^ and can be calculated by keeping 
track of all the constants in each step. The constant c also depends on the H^g and 
H2S norms of the transfer functions involved and the upper bound for the estimated 
parameters. 

To establish the boundedness of nif, we have to show that -^ttt < ^ for all 
t > or for most of the time. The boundedness of mf will follow directly if we 
modify the normalizing signal as m^ = l + n^, n^ = pQ + rUs and choose the constant 
/3o large enough so that 

cdn cdn , S 



m2(i) - /3o - 2 

Vt > 0. This means that m is always larger than the level of the disturbance. Such a 
large m will slow down the speed of adaptation and may in fact improve robustness. 
A slow adaptation, however, may have an adverse effect on performance. 

The boundedness of signals can be established, however, without having to 
modify the normalizing signal by using the properties of the C25 norm defined over 
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an arbitrary interval [ti,t\ given by Lemma 9.8.2, 9.8.3 and by repeating steps 1 to 
3 as follows: 

We apply Lemma 9.8.2 to (9.8.9) to obtain 

where we use the fact that ||^^(jJt||25„, ||j/j,t||2(5oi l|wpt||2(5o ^ cm{t). Therefore, the 
fictitious signal m^^ = e~'^(*~*i'm^(ti) + ||wp, ^^ p + ||yp, ,^ p satisfies 

mji < ce~^^*-*^'>m^{ti) + c\\e'^ujt,t, f + cA^m^^ + cdg Vi > ^i > 
Following the same procedure as in step 2 and using Lemma 9.8.2, 9.8.3 we obtain 

where g is as defined before. Therefore, 

Using (9.8.30), we obtain 

m\ <ce-*(*-*i)m2(ii) + c||(gm/Jt,tJ|2 + cd2, yt > h 



ml {t)<c + ce-'^(*^*i)m2(ii) + c / e-'^^'-^'>f{T)ml {T)dT 
Applying the B-G Lemma III, we obtain 



Vt > ii > 0. Because g e S{fo + Af + ;^), it follows as before that for c/o + cAf < 
6/2, we have 



(i) < mlit) < ce-^/2(*-*^)(l + m2(fi))e'^'' ""^"'"^ 



m^ 



Vt > ii, where the inequality m'^{t) < mi follows from the definition of mf^. If we 
establish that m, G >Cooj then it will follow from Lemma 9.8.1 that all signals are 
bounded. The boundedness of m, is established by contradiction as follows: Let us 
assume that m'^{t) grows unbounded. Because 6 G C^o, it follows that 



m\t) < e'=i(*-*'>)m2(to) 
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for some fci > 0, i.e., m'^{t) cannot grow faster than an exponential. As m^{t) grows 
unbounded, we can find a to > a > and a ^2 > ^o with a > t2 — to such that 
"^^(^2) > ae^" for some large constant a > 0. We have 

ae'^i" < m^{t2) < e'''^*'-'"'>m^{to) 

which implies that 

In m [to) > In a + ki[a — (^2 — ^o)] 

Because a > t2 — to, it follows that lnm'^{to) > Ina, i.e., ?7i^(fo) > a for to G 
(^2 - a,t2). 

Let ii = sup^<j {arg{m'^{T) = a)}. Since m'^{to) > a for all to G (^2 — ct,*2), 
it follows that ti < t2 — a and m?{t) > a \/t G [^1,^2) and t2 — ti > a. We now 
consider (9.8.33) with ti as defined above and t = t2. We have 

m^(i2) < c(l + a)e-''(*^-*i) + cS f ' e^'^^'-^^ds 

where = -k — ^. For large a, we have /3 = tt — ^ > and 

m2(t2)<c(l + a)e-''"+^ 

Hence, for sufiiciently large a, we have 'W?{t2) < c < a, which contradicts the 
hypothesis that 771^(^2) > ae'^i" > a. Therefore, m G £00, which, together with 
Lemma 9.8.1, implies that all signals are bounded. 

Step 4. Establish hounds for the tracking error. In this step, we establish 
bounds for the tracking error ei by relating it with signals that are guaranteed by 
the adaptive law to be of the order of the modeling error in m.s.s. We consider each 
adaptive law separately. 

Robust Adaptive Law of Table 9.2 Consider the tracking error equation 

ei = Wm{s)p*0^i^ + rjy 

We have 

\ei{t)\<\\Wm{s)\\2s\\9'^u;\\\p*\ + \r^y\ 

Therefore, 

\ei{t)\<c\\d'^cj\\ + c\r^y\ 

Using (9.8.21) and m/ G £00 in the above equation, we obtain 

|ei(i)|^ <c||gf + c( — + a^Aoo) + cdl + clrjyl^ 
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We can also establish that 
Therefore, 



\riy{t)\''<cAl + cdl 



\ei{t)\'<c\\gr + c 



"0 



■agAc 



Cdn 



cAi 



where g G S{fo + Aq2 + (Iq). Using Corollary 3.3.3, we can establish that H^H G 
iS(/o + Aq2 + dg) and, therefore. 



rt+T 

I 



\ei\^dT < c{fo + A"^ + dl)T + c 



where A 



A 



■Ai 



■ A2 



Robust Adaptive Law of Table 9.3 It follows from the equation of the estimation 
error that 

Because e,^, em G iS(/o+A2+(io) andp, tti G £00, it follows that ei G 5(/o+A|+(iQ). 

Robust Adaptive Law of Table 9.4 Substituting (9.8.27) in the tracking error 
equation 



1 



ei 



Wm{s)0'^ io + rjy 



and using 77 = CQr]y, we obtain 



ei 



1 

Co 

,2 I j2 



em^ + Wc{WbUj'^)e 



Using cj G £00, G 5(/o + A2 + dg) , we have that the signal ^ = Wc{WbUJ )9 G 
5(/o + A2 + dg). Since j-,m e Coo and em G S{fo + A2 + dg), it follows that 
e,eS{fo + Al + dl). 

Step 5: Establish parameter and tracking error convergence. As in the ideal 
case, we first show that 4>, (j)p is PE if r is dominantly rich. From the definition of 
0, (/)p, we have 



H{s) 



a{s) 
a(s) 

Vp 
r 



Wm{s)^Up 
Wm{s)Vp 

Vp 



where H{s) = Lq{s) for the adaptive law of Table 9.2 and H[s) = Wm{s) for the 
adaptive law of Table 9.3. Using yp = Wm{s)r + ei, Up = Gq {s){Wm{s)r + ei) —rji, 
rji = Am{s){up + du) + du, we can write 



4> = (l>m + 4>e, 4>p = (Ppm + (ppe 
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where 



(t>m = H{s) 



1 



r, (ppm = Wm{s) 



"(s) 



1 



0e = H{S) 



1 





ei - H{s) 



Ms) 








m 



^pe 



Wm{s) 
1 









»?1 



Because we have estabhshed that ei G iS(A^ + cJq + /o) and Up G >Coo, we conclude 
that <j)e,4>pe G iS(A^ + dp + /o). In Chapter 8, we have proved that (l)m,<t>pm are 
PE with level a^ > 0(A^ + cIq) provided that r is dominantly rich and Zp, Rp are 
coprime, i.e., there exist Tq > 0,Tpo > 0, ao > 0, Ofpo > such that 



1 



t+To 



ToJt 
Vi > 0. Note that 



(t>rn{T)(l>„i{T)dT > UqI , 



{T)<f^{T)dT > 



1 

Tpo Jt 



2nT, 



t + Tr,, 



4>pm{T)(l)Jjn{T)dT > Up^I 



t+nT„ 



Jt 



<l>ni{T)4>Zi{T)dT 



TlTo 



t+nTo 



MrHJ{r)dT 



> 



aa 



I 



c(A^ 



4 + /o) 



/ 



c 

where n is any positive integer. If we choose n to satisfy ^rS^ < ^, then for 
c(A2 + dl + fo)<^,we have 

ft+nTo 



1 



(/-(T)(/.^(r)dT > —I 



4 



which implies that cp is PE. Similarly, we can establish the PE property for (pp. 

Using the results of Chapters 4 and 8, we can establish that when cp, or (pp is 
PE, the robust adaptive laws guarantee that 6 converges to a residual set whose 
size is of the order of the modeling error, i.e., 9 satisfies 



\m\<c{fo + A + do) + rg{t) 



(9.8.34) 
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where rg{t) —> as t —> (X). Furthermore, for the robust adaptive law of Table 9.4 
based on the linear parametric model, we have rg{t) —> exponentially fast. Now 

ei(i) = —Wm{s)9'^uj + T]y (9.8.35) 

where riy = ~.\ " Wm{du + Am{s){up + d„)). Because uj e Coo and \r]y\ < c(A2 + 
do), we can conclude from (9.8.34) and (9.8.35) that 

\ei{t)\ < c(/o + A + do) + cr^it) (9.8.36) 

where re(i) = J^ h^it — T)rg{T)dT and hm{t) = C~'^{Wm{s)}. Therefore, we have 
r (.it) ^ Q as t ^ oo. Furthermore, when rg{t) converges to zero exponentially 
fast (i.e., the adaptive law of Table 9.4 is used), r^^t) —> exponentially fast. 
Combining (9.8.34) and (9.8.36), the parameter error and tracking error convergence 
to S follows. 



9.9 Stability Proofs of Robust APPC Schemes 

9.9.1 Proof of Theorem 9.5.2 

The proof is completed by following the same steps as in the ideal case and Example 
9.5.1. 

Step 1. Express Up,yp in terms of the estimation error. Following exactly the 
same steps as in the ideal case given in Section 7.7.1, we can show that the input 
Up and output j/p satisfy the same equations as (7.4.24), that is 

i = A{t)x + bi{t)em + 622/m 

Up = Cj X + diem"^ + d2ym (9.9.1) 

Up = C2 X + d^ern^ + d/^ym 

where x, Ait)^ bi{t), 62 and C^, i = 1,2, dj,, k = 1, 2, 3,4 are as defined in Section 7.7.1 
and ym = ^XTTJ/m- As illustrated in Example 9.5.1, the modeling error terms due 
to Am(s), du do not appear explicitly in (9.9.1). Their effect, however, is manifested 
in e, em, \\A(t)\\ where instead of belonging to C2 as in the ideal case, they belong 

to S{^ + /o). Because ^ < A^ + ^, we have e,em, \\A{t)\\ G 5(Ai + ^ + /o). 

Step 2. Establish the e.s. property of A{t). As in the ideal case, the APPC law 
guarantees that det{sl — A{t)) = A* [s] for each time t where A*[s) is Hurwitz. If 
we apply Theorem 3.4.11 (b) to the homogeneous part of (9.9.1), we can establish 
that A{i) is u.a.s which is equivalent to e.s. provided 

1 /•*+^ dl 



c{f„ + Al+- I -^dr) < /i* (9.9.2) 
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Vt > 0, any T > and some fi* > where c > is a finite constant. Because 
m^ > 0, condition (9.9.2) may not be satisfied for small A2, /o unless do, the upper 
bound for the input disturbance, is zero or sufficiently small. As in the MRAC 
case, we can deal with the disturbance in two different ways. One way is to modify 
m^ = 1 + nis to m^ = 1 + /3o + rng where /3o is chosen to be large enough so that 
c— %■ < Ctt < ^, say, so that for 

c(/o + Al)<^ 

condition (9.9.2) is always satisfied and A{t) is e.s. The other way is to keep the same 
m^ and establish that when m^ grows large over an interval of time /i = [^1,^2], 
say, the state transition matrix <l>(t,r) of A{t) satisfies ||<l>(i,r)|| < fcie"*^^*-*""^' 
\/t > T and t,T E Ii. This property of A{t) (when m^ grows large) is used in 
Step 3 to contradict the hypothesis that m^ could grow unbounded and conclude 
boundedness. 

Let us start by assuming that m^ grows unbounded. Because all the elements 
of the state x are the outputs of strictly proper transfer functions with the same 
poles as the roots of A(s) and inputs Up, j/p (see Section 7.7.1) and the roots of A(s) 
are located in Re[s] < —So/2, it follows from Lemma 3.3.2 that — G Coc- Because 
yrmi^rn G C-oo, it follows from (9.9.1) that ^, ^ G Loo- Because u'i,y'i are bounded 
from above by m^ , it follows from the equation for m? that m? cannot grow faster 
than an exponential, i.e., 'm?{t) < e^'^^^~*°''m?{to),yt > to > Q for some fc > 0. 
Because m'^{t) is assumed to grow unbounded, we can find a. to > a > for any 
arbitrary constant a > t2 — to such that 771^(^2) > ae'^^°'. We have 



ae'^i" < m^{t2) < e'''^*^^'"'>m^{to) 



which implies that 



In m [to) > In a + ki[a — (^2 — ^o)] 
Because a > t2 — to and to G (^2 — ci, ^2), it follows that 

m?{to) > Oi, Vto e (^2 - a,t2) 

Let ti = sup^<( {arg{m'^{T) = a)}. Then, m^(ti) = a and m'^{t) > a,\/t G [^1,^2) 
where ii < ^2 — S, i.e., ^2 — ^1 > ck- Let us now consider the behavior of the 
homogeneous part of (9.9.1), i.e., 

Y = A{t)Y (9.9.3) 

over the interval Ii = [ti, ^2) for which m'^{t) > a and t2 — ti > a where a > is an 
arbitrary constant. Because det(s/ — A{t)) = A*{s), i.e., A{t) is a pointwise stable 
matrix, the Lyapunov equation 

A'^{t)P{t) + P{t)A{t) = -I (9.9.4) 
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has the solution P{t) = P'^ {t) > for each t E Ii. If we consider the Lyapunov 
function 

V{t) = Y^{t)P{t)Y{t) 

then along the trajectory of (9.9.3), we have 

V = -Y^Y + Y^PY < -Y^Y + \\P{t)\\Y^Y 

As in the proof of Theorem 3.4.11, we can use (9.9.4) and the boundedness of P, A 
to establish that ||P(i)|| < c||i(i)||. Because XiY^Y < V < Aa^^F for some 
< Ai < A2, it follows that 

V < -{^2' - cK'\\A{t)\\)V 

i.e., 

V{t) < e^/^^2-'-c\-'ll'4(«)ll)d«^^^^ 

V t > T > 0. For the interval /i = [^1,^2), we have m?{t) > a and, therefore, 
/ \\A{T)\\dr<c{Al + fo+^){t-T) + c 

and therefore, 

V(t) < e-^"(*-"V(T), Vt,T G [h,t2) (9.9.5) 



and t > T provided 



c(/o + A^ + ^) < Ao (9.9.6) 

a 



where Ag = -|— . From (9.9.5) we have 

XiY^{t)Y{t) < Y^{t)PY{t) < e-^"(*-^)A2r^(T)y(r) 
which implies that 

in^)|<^e-'"(*-^)|>'(r)|, yt,re[t„t,) 

which, in turn, implies that the transition matrix <l>(f,T) of (9.9.3) satisfies 

mt,T)\\ < /3oe-"°(*-^), Vi,T e [ii,i2) (9.9.7) 

where /3o = w^,q;o = -^- Condition (9.9.6) can now be satisfied by choosing 

a large enough and by requiring A2,/o to be smaller than some constant, i.e., 

X -1 
c(/o + A|) < -2—, say. In the next step we use (9.9.7) and continue our argument 

over the interval p in order to establish boundedness by contradiction. 
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Step 3. Boundedness using the B-G Lemma and contradiction. Let us apply 
Lemma 3.3.6 to (9.9.1) for t G [ii,i2)- We have 

where ||(-)t.till denotes the £215 norm ||(-)t,ti ||2(5 defined over the interval [^1,^), for 
any Q < 5 < 5i < 2aQ. Because — G £00 it follows that 

II^mJI < ce^'/''*~*^'m(ii) + c||(em2)t,tj| + c 

Because ||ypt,tj|, llMpt.tJI < c||xt,tj| + c\\{em'^)t^tA\ + c, it follows that 

hptM I \WptM II < ce-^/2(*-*^)m(ti) + c\\{em%,t, \\ + c 

Now m'^{t) = 1 + ms{t) and 

mS) = e-'"<^'-'^^ms{ti) + \\ypt,tA + \Kt,u\\lso 

Because ||(-)t,ti lb*,, < IKOt.tJI for S < 5q, it follows that 

m\t) = 1 + ms{t) < 1 + e-*'>(*-*i)m2(ii) + \\ypt^t^ f + \\upt,u f Vt > ti 

Substituting for the bound for ||ypt,tj|, ||wpt^tj|| we obtain 

m^{t) < ce"'^(*^*i)m2(ti) + c||(em2)t^4j|2 + c Vi > ii > 

or 

m^{t) < c+ ce"''(*"*^)m2(ti) + c f e-^^*^^'>e^m^m^{T)dT (9.9.8) 

Applying B-G Lemma III we obtain 

m\t) < c(l + m2(ti))e^'(*-*^'e'^'i ''"''" + c6 f e-'^'-'^e'I^ ^'"''^^ds, Vi > h 



Jt 
For i, s e [ti, ^2) we have 

c / e'^m'^dT <c(Al + fo + — ]{t-s)+c 



By choosing a large enough so that c-|- < j and by requiring 

c(A2 + /oX J 
we have 

\t2) < c{l + 'n?{ti))e-i''^^-*'^ +c5 r e-i^^^-'Us 
< c(l + m2(ti))e"5(*^"*iXc 



m ' 
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Because t2 — ti > a,m'^{ti) = a and m^(t2) > a, we have 

a < m^{t2) < c(l + a)e~^ + c 

Therefore, we can choose a large enough so that 771^(^2) < a which contradicts the 
hypothesis that ?TC^(i2) > ct. Therefore, m G Ccc which implies that x,Up,yp G Ccc- 
The condition for robust stability is, therefore, 

c(/o + A^)<min{^,^}^<5* 
for some finite constant c > 0. 

Step 4. Establish bounds for the tracking error. A bound for the tracking 
error ei is obtained by expressing ei in terms of signals that are guaranteed by the 
adaptive law to be of the order of the modeling error in m.s.s. The tracking error 
equation has exactly the same form as in the ideal case in Section 7.7.1 and is given 
by 

A{s)s^-^Q^{s) A(fKU(f) 

'' = AH^) ^"^ + A*is) "° 

(see equation (7.7.21)) where vq is the output of proper stable transfer functions 
whose inputs are elements of 9p multiplied by bounded signals. Because 9p,em^ G 
S{^ + /o) and ^ < c(A2 + d^), due to m G C^oj it follows from Corollary 3.3.3 
that ei G ^(Aj + d^ + fo) and the proof is complete. 

9.9.2 Proof of Theorem 9.5.3 

We use the same steps as in the proof of Example 9.5.2. 

Step 1. Develop the state error equations for the closed-loop plant. We start 
with the plant equation 

RpVp = Zp{l + Am){Up + du) 

Operating with q(\ on each side, we obtain 

Rp-p^Vp = -f^PTV^ei = Zp'^P + Zp—^[Ajn{up + du) + du] 

i.e., 

ei = ^ Mp + [Am{Up + du) + du\ 

Because -^^Am is strictly proper, we can find an arbitrary polynomial A(s) whose 
roots are in Re[s] < —6q/2 and has the same degree as Rp, i.e., n and express ei as 

ZpQi _ AQjn , , 

ei = -jrj^up + iTrr'^ (^•^•^) 
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where 



11= -r- [^m{up + du) + du] 



We express (9.9.9) in the following canonical state-space form 



where C^{sl - Ay'^B 



e 
ei 



Ae + Bup + BiT] 
e + diTj 



C^ 



(9.9.10) 



RpQ 

In+q-1 





C^{sI-A)-^Bi + di 



RpQr, 



with 



„n+q 



B = e;, c^ = [i,o,...,o] 



^1 Oin+q-l{s), ZpQi — 0'2 a„+g_i. 



and 01,62 are defined as RpQ„ 

It follows that Co = e — e is the state observation error. From the equation of e 
in Table 9.6 and (9.9.10), and the control law Up = —Kc{t)e, we obtain 



k = Ac{t)e + KoC'^Co + KodiT] 

to = AoBo + Oiei - d2Up + B2ri 
where B2 = Bi — 6idi — Ko{t)di and 

In+q-l 





(9.9.11) 
(9.9.12) 



whose eigenvalues are equal to the roots of j4*(s) and therefore are located in 

93. The plant 



Re[s] < -5q/2- Ac(i) = i - BK^ and h = 91-91,92 = 62 



output satisfies 



yp = C^Co + C^e + Vra+ diT] 



(9.9.13) 



As shown in Section 7.3.3, the polynomials Zp,Qi,Rp,Qm satisfy the equation 
(7.3.25), i.e., 

RpQ„,X + ZpQiY = A* (9.9.14) 

where X, Y have degree n + q— I, X is monic and A* is an arbitrary monic Hurwitz 
polynomial of degree 2(n + q) — I that contains the common zeros of Qi, RpQm- 
Without loss of generality, we require A* {s) to have all its roots in Re[s] < —Sq/2. 
From (9.9.14) and QmUp = QiUp, it follows that 



RpXQi QiYZp 



9.9. STABILITY PROOFS OF ROBUST APPC SCHEMES 765 



Because Rpi/p = ZpUp + Zp[Am{up + d„) + dy], we have 

„,= ^„,+ 0^,,_02l^, ,,.,15, 

by using the definition of A, rj given eariier. 

Equations (9.9.11) to (9.9.15) together with Up = —Kc{t)e describe the stability 
properties of the closed-loop APPC scheme of Table 9.6. 

Step 2. Establish stability of the homogeneous part of (9.9.11) and (9.9.12). 
The stability of the homogeneous part of (9.9.12) is implied by the stability of 
the matrix A^ whose eigenvalues are the same as the roots of A*(s). Because 
det(s/ — Ac{i)) = A*^{s), we have that Ac{t) is pointwise stable. As we showed in 
the ideal case in Section 7.7.2, the assumption that Zp,QiRp are strongly coprime 
implies that {A, B) is a stabilizable pair [95] in the strong sense which can be used to 

show that Kc, Kc are bounded provided 6i, 02, ^i, ^2 G Coo- Because the coefficients 
of Zp{s, t), Rp{s, i) generated by the adaptive law are bounded and their derivatives 

belong to e S{^ + /o), it follows that \e,l\k\AKc\,\k,\ e Coo and \e,\,\k,\ e 
'5(^ + /o)fori = 1,2. Because Ac = A- Si'c, it follows that ||Ac(i)||, ||ic(i)|| e >Coo 
and ||Ac(i)|| G S{if /rri^ + f^). Because J^ < A2-|-/g i^^^rjy^dT where rfo is an upper 
bound for |rf„|, the stability oi Ac{t) cannot be established using Theorem 3.4.11 (b) 
unless -B- is assumed to be small. The term do/m can be made small by modifying 
m to be greater than a large constant /3o, say, all the time as discussed in the proof 
of Theorem 9.5.2. In this proof we keep the same m as in Table 9.6 and consider 
the behavior of the state transition matrix <l>(f,T) of Ac{t) over a particular finite 
interval where m{t) has grown to be greater than an arbitrary constant a > 0. The 
properties of <l>(t,T) are used in Step 3 to contradict the hypothesis that m? can 
grow unbounded and conclude boundedness. 

Let us start by showing that m cannot grow faster than an exponential due to 
the boundedness of the estimated parameters A,B. Because {C,A) in (9.9.10) is 
observable, it follows from Lemma 3.3.4 that 

|e(t)|, ||et||25„ < cllVlb^o + 4vt\\25„ + cWVpthso + c 

Because Up = yf-Up, it follows from Lemma 3.3.2 that ||upt||25o 5- cm which together 
with ||?7t||25o ^ A2m imply that e/m G Coo- Similarly, applying Lemma 3.3.3 to 
(9.9.12) and using 6i G Coo, we can establish that eo/m G Coo which implies that 
e = e — Co is bounded from above by m. From (9.9.13), (9.9.15), it follows that 
Up/m,yp/m G Coo which together with the equation for rn^ imply that m^(t) < 
gfci(t-to)yj^('^g') \/t > to > for some constant fci. 

We assume that m?{t) grows unbounded and proceed exactly the same way as 
in Step 2 of the proof of Theorem 9.5.2 in Section 9.9.1 to show that for 

c{Al + /o) < A 
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and some constant A > that depends on the pointwise stabihty of Ac{t), we have 

where t2 — ti > a.,im?{ti) = a,m?{t2) > (56*^^" > a, m'^{t) > a\/t <^ [*i,*2) and a 
is large enough so that rfo/S < cA. 

Step 3. Boundedness using the B-G Lemma and contradiction. Let us apply 
Lemma 3.3.6 to (9.9.11) for t e [^1,^2)- We have 

||e*.*J| < ce-i(*-*^)|e(ii)l + c||(C^eo)MJI + c^mJI 

where ||(-)t.till denotes the >C2(5-norm ||(-)t^tj II25 for some (5 > 0. Because e/m G £00, 
we have 

PmJI <ce-'(*-*^)m(ii) + c||(C^eo)MJI+c||ryt,tJ| (9.9.16) 

From (9.9.13), we have 

WVpt.tA < c\\iC^eo)t,tA\ + c\\et,tA\ + c\\vt,tA + c (9.9.17) 

Applying Lemma 3.3.6 to (9.9.15) and noting that the states of any minimal state 
representation of the transfer functions in (9.9.15) are bounded from above by m 
due to the location of the roots of A*{s) in Re[s] < —do/2 and using Up = —KcS, 
we obtain 

\\upt,tA < 4^t,u\\ + 4ypt,u\\ + 4vt,u\\ + ce'^^'~''^Mti) (9.9.18) 

Combining (9.9.16), (9.9.17) and (9.9.18) we have 

mlit) = e-'"('~'^^m\t,)+\\upt,tA\^+\\yptMf (9-9.19) 

< ce-^(*-*i)m2(fi) + c||(C^e„)t,tJ|2 + cU^^A + c,Vi G [^1,^2) 

Now from (9.9.12) we have 

C^eo = C^{sI-Ao)-\0iei-02Up) + C^{sI-Ao)-^B2V 

Following exactly the same procedure as in Step 3 of the proof of Theorem 7.4.2 in 
Section 7.7.2 in dealing with the first term of (9.9.20), we obtain 

C^eo = ^p(")Q";(") g^2 ^ ^^ ^ ^(^)^ (9 9 21) 

^S(s) 

where r2 consists of terms of the form Wi{s)oj'^ Op with oo/m € Coo and Wi{s), W{s) 
being proper and analytic in Re[s] > — (5o/2. Applying Lemma 3.3.5 to (9.9.21) 
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and noting that any state of a minimal state-space representation of the transfer 
functions in (9.9.21) is bounded from above by m, we obtain 

||(C^eo)MJI<ce-t(*-*i)^(t,) + c||(em2),,,J|+c||(^pm)t,tJ|+c||ryt,tJ| (9.9.22) 

Using (9.9.22) in (9.9.19), and noting that ||?7t.tJ| < Aqo'ti/j, we obtain 

m}^{t) < ce-*(*-*i)(l + m^ih)) + c\\{gm)t,t,f + cA^mf,{t), Vt G [h,t2) 

where g^ = e^m? + \0p\'^ . Therefore, for 

cA^ < 1 (9.9.23) 

we have m?{t) < ml (t) and 

m^{t) < ce^^^*-*'\l + m^{ti)) + c f f{T)m^{T)dT, Mt e [ii,i2) (9.9.24) 

Applying B-G Lemma III we obtain 

m\t) < c(l + m2(ii))e-^(*-*^)e'^'i^'''^'%c^ T e^*(*-^)e^X'^'(^)''^ds 



Because m'^{t) > a Wt e [^1,^2), we have cjlg'^{T)dT < c(A| + /o + §-){t - s) + 

c,\/t,s G {ti,t2). Choosing a large enough so that c-^ < |, and restricting A2,/o 
to satisfy 

c(A2 + /o)<- (9.9.25) 

we obtain 



Hence, 



m-{t2) < c(l + m^(ti))e"i(*=~*i' + c 



a < m^(i2) < c(l + a)e " + c 

which implies that for a large, m'^{t2) < a which contradicts the hypothesis that 
m?{t2) > ct- Hence, m e £00 which implies that e,e,eo,yp,Up G £00- 

Using (9.9.23), (9.9.25) and c(A2-l-/o) < A in Step 2, we can define the constants 
AJ^, 5* > stated in the theorem. 

Step 4. Tracking error hounds. The tracking error equation is given by 

ei = C^ eo + C^ e + di'q 

We can verify that the >C2e-norm of e and C^ Eq satisfy 

||et||2e < c\\{C'^eo)the+c\\l^t\\2e 
||(C^eo)t||2e < C\\emt\\2e + C\\ept\\2e+C\\l^t\\2e 
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by following the same approach as in the previous steps and using (5 = 0, which 
imply that 

\\eit\\l= f^dr < c [\e'm' + \ep\' + r,^)dT 
Jo Jo 

< c{Al + fo + dl)t + c 
and the proof is complete. □ 



9.10 Problems 

9.1 Show that if w = sintoot is dominantly rich, i.e., < loq < 0(l//x) in Example 

9.2.3, then the signal vector cf) is PE with level of excitation ag > 0{^). 

9.2 Consider the nonminimum-phase plant 

1 — /is 



Vp = G{s)up, G{s) 



s 



2 



where fi > is a small number. 

(a) Express the plant in the form of equation (9.3.1) so that the nominal 

part of the plant is minimum-phase and the unmodeled part is small for 
small fi. 

(b) Design a robust MRAC scheme with a reference model chosen as 



H + 1.4s + 1 

based on the nominal part of the plant 

(c) Simulate the closed-loop MRAC system with a = —3, 6=2 and r =step 
function for /i = 0, 0.01, 0.05, 0.1, respectively. Comment on your simu- 
lation results. 

9.3 In Problem 9.2, the relative degree of the overall plant transfer function is 

n* = I when /i 7^ 0. Assume that the reference model is chosen to be 
Wm,i{s) = gl2 • Discuss the consequences of designing an MRAC scheme 
for the full order plant using Wmi{s) as the reference model. Simulate the 
closed-loop scheme using the values given in part (c) of Problem 9.2. 

9.4 For the MRAC problem given in Problem 9.2, 

(a) Choose one reference input signal r that is sufficiently rich but not dom- 
inantly rich and one that is dominantly rich. 
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(b) Simulate the MRAC scheme developed in Problem 9.2 using the input 

signals designed in (a). 

(c) Compare the simulation results with those obtained in Problem 9.2. 

Comment on your observations. 

9.5 Consider the plant 

1 

s{s + a) 
where a is an unknown constant and 

9 

y-n 



(s +3)2 
is the reference model. 

(a) Design a modified MRAC scheme using Method 1 given in Section 9.4.2 

(b) Simulate the modified MRAC scheme for different values of the design 

parameter t. 

9.6 Consider Problem 9.2. 

(a) Replace the standard robust MRAC scheme with a modified one from 

Section 9.4. Simulate the modified MRAC scheme using the same pa- 
rameters as in Problem 9.2 (c) and t = 0.1. 

(b) For a fixed /i (for example, /i = 0.01), simulate the closed MRAC scheme 

for different t. 

(c) Comment on your results and observations. 

9.7 Consider the speed control problem described in Problem 6.2 of Chapter 6. 

Suppose the system dynamics are described by 

V = ^{i + /\m{s))e + d 

s + a 

where li is a bounded disturbance and A„j represents the unmodeled dynam- 
ics, and the reference model 

S-F0.5 
is as described in Problem 6.2. 
(a) Design a robust MRAC scheme with and without normalization 



and d = for /i = 0, 0.01, 0.2. Comment on your simulation results. 



(b) Simulate the two schemes for a = 0.02sin0.01t, b = 1.3, Am(s) 
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9.8 Consider the plant 

y = M- nAa{s)u 

s — a 

where /i > is a small parameter, a is unknown and Aa(s) is a strictly proper 
stable unknown transfer function perturbation independent of fi. The control 
objective is to choose u so that all signals are bounded and y tracks, as close 
as possible, the output y^ of the reference model 

1 

Vn 



s+l 
for any bounded reference input r as close as possible. 

(a) Design a robust MRAC to meet the control objective. 

(b) Develop bounds for robust stability. 

(c) Develop a bound for the tracking error ei = y — y^- 

Repeat (a), (b), (c) for the plant 



y 



s — a 

where r > is a small constant. 
9.9 Consider the following expressions for the plant 

Vp = Go{s)up + Aa{s)up (9.10.1) 

Na{s) + AAs) 
Do{s) + A2(s) 

where A^, Ai, A2 are plant perturbations as defined in Section 8.2 of Chapter 

8. 

(a) Design a model reference controller based on the dominant part of the 

plant given by 

Vp = Go{s)up (9.10.3) 

where Go{s) = jf\^ = ^p Rffr satisfies the MRAC Assumptions PI to 
P4 and 

y-m = W„i{s)r = fcm n , , r 
Rni{sj 

is the reference model that satisfies Assumptions Ml and M2 given in 
Section 6.3 of Chapter 6. 

(b) Apply the MRC law designed using (9.10.3) to the full-order plants given 

by (9.10.1), (9.10.2) and obtain bounds for robust stability. 



9.10. PROBLEMS 771 

(c) Obtain bounds for the tracking error ei = Vp — Hm- 

9.10 Consider the plant 

yp = Go{s)up + Aa{s)up 

where 

yp = Go{s)up 

is the plant model and Aa(s) is an unknown additive perturbation. Consider 
the PPC laws given by (9.5.3), (9.5.5), and (9.5.7) designed based on the 
plant model but applied to the plant with Aa(s) ^ 0. Obtain a bound for 
Aa(s) for robust stability. 

9.11 Consider the plant 

_ iVp + Ai 

^P- D0 + A2'''' 

where Gq = w^ is the modeled part and Ai,A2 are stable factor perturba- 
tions. Apply the PPC laws of Problem 9.10 to the above plant and obtain 
bounds for robust stability. 

9.12 Consider the robust APPC scheme of Example 9.5.1 given by (9.5.18), (9.5.19) 
designed for the plant model 

b 



Vp , ^p 

s + a 

but applied to the following plants 

(i) yp = ; Up + Aa{s)Up 

8 + a 






s+Ao 

where Aa(s) is an additive perturbation and Ai(s),A2(s) are stable factor 
perturbations and Aq > 0. 

(a) Obtain bounds and conditions for Aa(s), Ai(s), A2(s) for robust stabil- 

ity. 

(b) Obtain a bound for the mean square value of the tracking error. 

(c) Simulate the APPC scheme for the plant (i) when b = 2(1-1-0.5 sinO.Oli), 

a = -2sin0.002i, Aa(s) = --^^^ for ^i = 0,0.1,0.5,1. 

9.13 Consider the robust APPC scheme based on state feedback of Example 9.5.2 
designed for the plant model 

_ b 

Vp — ; ^p 
s + a 
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but applied to the following plants: 



(i) 
(ii) 



Vp 



-Up + Aa{s)Up 



Vp 



S + \l 



+ Ai(s) 



where A(j(s) is an additive perturbation and Ai(s),A2(s) are stable factor 
perturbations and Ao > 0. 

(a) Obtain bounds and conditions for Aa(s), Ai(s), A2(s) for robust stabil- 

ity. 

(b) Obtain a bound for the mean square value of the tracking error. 

(c) Simulate the APPC scheme with plant (ii) when 



1, a 



-2sin0.01^, Ao = 2, Ai(s) 



(e- 



1) 



s + 2 

for T = 0,0.1,0.5,1. 
9.14 Simulate the ALQC scheme of Example 9.5.3 for the plant 



A2(s) = 



Vp 



-(1 + A„(s))up 



s + a 
where Am(s) = -y+JTs ^'^^ A* > 0. 

(a) For simulation purposes, assume h = —1, a = —2(1 + 0.02 sinO.li). Con- 

sider the following values of /i: /i = 0, /i = 0.05, /i = 0.2, /i = 0.5. 

(b) Repeat (a) with an adaptive law that employs a dead zone. 
9.15 Consider the following MIMO plant 



2/2 



hii{s) hi2{s) 
h22{s) 



Ul 
U2 



where hu 
stable. 



s+ 



^,hi2 = ^A(s),/l22 



s+a2 



and A(s) is strictly proper and 



(a) Design a decentralized MRAC scheme so that j/i, 7/2 tracks r/mi, ym2, the 
outputs of the reference model 



ym2 



1 

s+1 







2 

s+2 J L 



ri 
r2 



for any bounded reference input signal ri , r2 as close as possible. 
(b) Calculate a bound for ^A(s) for robust stability. 
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9.16 Design a MIMO MRAC scheme using the CGT approach for the plant 

X = Ax + Bu 
y = C^x 

where x G Ti? , u G 7?,^, y G TZ^ and {A, B, C) corresponds to a minimal state 
representation. The reference model is given by 



Xft 
Vn 







Simulate the MRAC scheme when 

-3 1 

0.2 





' 1 ' 




' 1 ' 


, B = 




, c = 






2 


7 ^-^ 


1 



Appendix 



A Swapping Lemmas 

The following lemmas are useful in establishing stability in most of the adap- 
tive control schemes presented in this book: 

Lemma A.l (Swapping Lemma A.l) Let 6,w : TZ~^ >-^ 7^" and he 

differentiahle. Let W{s) he a proper stahle rational transfer function with a 
minimal realization (A,B,C,d), i.e., 



Then 



where 



W{s) = C'^ {si - A)-^ B + d 

W{s)¥u: = e'^W{.s)uj + Wc{s) ({Wh{s)uj'^)e 



Wc{s) = -C^{sl - A)-\ Wb{s) = {si - A)-^B 
Proof We have 

VF(s)Fw = W{s)Lo^e = d¥uo + C'^ [ e'^^^^^^Boj^OdT 

Jo 



5T, 



de'co + C'e''' { I e-'"'BLU ' {a)dae{T) 

ft PT 

,-Aa r>, ,T 



T=0 



"'0 

duj + C'^ [ e^^*-''^Buj{a)da 
Jo 

Jo Jo 



(A.l) 
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Noting that 



duj + C'^ I e^^*-'''> BLj{(7)da ={d+ C'^{sl - A)-^B)uj = W{s)l 

f e"^^^-"^ Buj'^ {a)da = {si - A)-^Bu 
Jo 





t 



ILO^ 



'0 

and 



C^ f e^'^*-^^f{T)dT = C'^{sI-A)-^f 
Jo 



'0 

we can express (A.l) as 

W{s)Fuj = Fw{s)uj - C^{sl - A)-^ I {{si - A)-^Buj'^) e\ (A. 2) 

and the proof is complete. □ 

Other proofs of Lemma A.l can be found in [201, 221]. 

Lemma A. 2 (Swapping Lemma A. 2) Let 9,uj : TZ'^ ^^ LV^ and 9, to be 

differentiahle. Then 



uj = Fi(s,ao) 



:.T 



LO + e^LO 



+ F(s,ao)[^^a;] (A.3) 



where F{s,ao) = ,"° .f. , Fi{s, qq) = i^^.aoj ^ ^ y -^ ^^^ aQ > is an 

arbitrary constant. Furthermore, for ao > 6 where 5 > is any given 
constant, Fi(s,ao) satisfies 

\\Fiis,ao)\U<^ 

for a finite constant c e TZ~^ which is independent of uq. 
Proof Let us write 

e'^LU = (1 - F{s, ao)) Fuj + F{s, aa)F uj 
Note that 

k k k 

( r-. I ^ \k \ ^ r-ii A ^k—i ^k i \ ^ /^i A ^k—i ^k i ^ \ ^ r-ii A~l ^k—i 

(s + ao) = 2_^C^s a^ =a^ + ^C^s a^ =aQ + s^Cf^s a^ 

i=0 i=l i=l 
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where CI = jr^izriy. i^- = 1)> "^e have 



—l^k—i 



Defining 



we can write 



1 - F{s,ao) 



Fi{s,ao) 



{s + ao)'' (s + ao)'' 



(s + Qfo)'^ S 



Fuj = Fi{s,aa)s{0'^Lu) + F{s,ao){9'^Lu) 

= Fi{s,aa){e uj + Fi:j) + F{s,ao){e'^u;) 
To show that H-fils, ao)lloo(5 — "^ ^'-'^ some constant c, we write 



(A.4) 



Fi{s,ao) 
Because 



^k ^j ^i_i fc-i 



j:Ucis^-'4 



T^^h 



^ k — i 



(s + ao)'= s + aof^^ {s + aoY^^s + ao)''"' 



{s + aoY 



oo5 



ao 



s-\- ao 



CO (5 



2qo 
2q;o — S 



and 



we have 



s + ao 



2 2 

< 



2ao — 6 ao ' 



(s + ao) 



i-l 



|Fi(s,ao) 



< 



1 



s + ao 



oo(S i^i 



(s + ao)*-i 



<2\ i > 1 



1, « > 1 



, fc— -i 



oo(5 



(s + ao)'' 



A; — 2 



oo(5 



Eti Gfe2* 



2ao-<5 



< 



ao 



A ,-^k 



where c = X^j^j^ C'^2'^ *+^ is a constant independent of ao- The above inequalities 
are established by using ao > S. □ 



In the stability proofs of indirect adaptive schemes, we need to manipu- 
late polynomial operators which have time- varying coefficients. We should 
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note that given o(t) G 7e"+\ and a„(s) = [s", s"-^ . . . , s, 1]^, A{s ,t) , A{s ,t) 
defined as 

A{s,t) = anit)s"- + a„_i(t)s"-^ + ■ ■ ■ + ai{t)s + ao(t) = a^it)anis) 

A{s, t) = s'^anit) + s"-^a„_i(t) + ■ ■ ■ + sai(t) + ao(t) = a^(s)a(t) 

refer to two different operators because of tlie time- varying nature of a{t). 
For the same reason, two polynomial operators with time- varying parameters 
are not commutable, i.e., 

A(s, t)B(s, t) / B{s, t)A{s, t), A(s, t)B(s, t) / B{s, t)A{s, t) 

The following two swapping lemmas can be used to interchange the sequence 
of time-varying polynomial operators that appear in the proof of indirect 
adaptive control schemes. 

Lemma A. 3 (^Swapping Lemma A.3j. Let 

A{s, t) = anit)s"- + a„_i(t)s""^ + • • ■ ai{t)s + ao(t) = a^it)anis) 

B{S, t) = brn{t)s^ + 6™-l(t)s"-^ + ■ ■ ■ bi{t)s + bo{t) = h'' {t)am{s) 

he any two polynomials with differentiahle time-varying coefficients, where 
a = [an, an-i, ■■■, aoV , b = [6^, 6^_i, . . . , 6o]^, a{t) G 7^"+^ b{t) G 7^'"+l 
and aj(s) = [s*, s*~-^, • • • , s, 1]. Let 

C\s, t) = A{s, t) ■ B{s, t) = B{s, t) ■ A{s, t) 

be the algebraic product of A(s,t) and B(s,t). Then for any function f(t) 
such that C{s,t)f, A{s,t){B(s,t)f), B{s,t)(A{s,t)f) are well defined, we 
have 

(i) A{s, t){B{s, t)f) = C{s, t)f + a'' {t)Dn-i{s) [an_i{s){al{s) f)h\ 

(A.5) 
and 
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(ii) A{s,t){B{s,t)f) = B{s,t){A{s,t)f) + G{s,t) {H{s)f) 



a 
b 



(A.6) 



where 



^r.T; 



G{s,t) = [a' Dn-l{s),b^ Drn.lis)] 

Di(s), H(s) are matrices of dimension (i + 2) x (i + 1) and (n + m) x 
(n + 1 + rTi, + 1) respectively, defined as 



Di{s) 



i 


s 


s' 




s 





1 


s 




s'-' 










1 


s 












1 
















His] 



A 



a„_i(s)a^(s) 

-am-i(s)aj(s) 



Proof (i) Using the relation s(/i/2) = /is/2 + (s/i)/2, we can write 



n m 



A{s, t){B{s, t)f) = aoB{s, t)f + ^ a^ ^ s^ {b,s^ f) 



n m 






n ra 



aoB{s, t)f + 5] a^ 5] [s'~^ {b.s'^^f + b.s'+'f) + s'-%s^ f 



i=l j=0 



n ra 



aoB{s, t)f + Y,^^Y.( ^I'^'^'f + E *' (b,s^+'-'-''f 



n m 71 m i—1 



Y^a^Y. b,s^+^f + E E E •'^' (b,s=^'-'-'f) = C{s, t)f + r{t) 

i=0 j=n i=l j=0 k=0 



(A.7) 



(A.7) 



where 



n i — 1 m 



io = E««E-''E(M^'^^"^-v 

i=l fc=0 j=0 
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and the variable t in a, &, / is omitted for the sake of sinipUcity. 

From the expression of r(f), one can verify through simple algebra that 



r{t) = a^ Dr^-i{s)n{t) 



(A.8) 



where 



rb{t) 



A 



To simplify the expression further, we write 






n{t) 



V 

(a„_i(s)a^(s)/)6 



o«-2 



\ 




bm 


/ 




bm~l 


/ 




. bo . 



(A.9) 



Using (A.8) and (A.9) in (A. 7), the result of Lemma A. 3 (i) follows immediately, 
(ii) Using the result (i), we have 

A{s,t){B{s,t)f) = C{s,t)f + a'^D^^i{s) ([«„_i(s)a;[,(s)/] bj (A.IO) 

B{s,t){A{s,t)f) = C{s,t)f + b^D^^i{s) {[a„,^^{s)al{s)f] a) (A.ll) 

Subtracting (A.ll) from (A.IO), we obtain 

A{s, t){B{s, t)f) - B{s, t){A{s, t)f) (A.12) 

= a^Ai-i(s) ( [(a„_i(s)a^j(s)/] 6) - b^ Dm-i{s) {[{am-i{s)a^{s)f] a) 



The right-hand side of (A.12) can be expressed, using block matrix manipulation. 



[a^i5„_i(s),6^i?„_i(s)] 



an-i{s)a^{s) 

-am-i{s)al{s) 



and the proof is complete. 



D 
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Lemma A. 4 (Swapping Lemma A. 4) Let 

A{s,t) = anit)s'^ + a„_i(t)s"-i + ■ ■ ■ ai(t)s + ao(t) = a^(i)a„(s) 

A{s, t) = s''an{t) + s"-ia„_i(f) + ■ ■ ■ sai{t) + ao(t) = al{s)a{t) 
B{s, t) = bm{t)s^ + 6^_i(t)s™-i + • • • bi{t)s + 6o(i) = 6^(t)a„(s) 

B{s, t) = s^hm{t) + s^-^h^_i{t) + ■■■ shi{t) + bo{t) = al{s)b{t) 



:=^, a(t)e7^"+^6(t)e7^™+l anda,h^Coo, a^ = [s\■ ■ ■ ,s,l]^ . 

n m n m 



A{s, t) ■ B{s, t) = E E «'ibjs'+', A{s, t) ■ B{s, t) = J2Yl ^"^'^i^i 

i=0 j=0 i=0 j=0 

he the algebraic product of A(s,t), B(s,t) and A(s,t),B(s,t), respectively. 
Then for any function f for which A(s,t) ■ B(s,t)f and A(s,t) {B(s,t)f) 
and B(s,t) (A(s,t)f) are defined, we have 



(i) Ais,t)iBis,t)f) = Bis,t)iAis,t)f) + alis)Fia,b)anis)f (A.13) 

where n = ioaax{n,m} — 1 and F(a,b) satisfies \\F(a,b)\\ <ci|d| + C2|6| 
for some constants ci,C2 



1 A 1 .. .. „. .. „ ,T, 



{ii) A{s, t) iB{s, t) -—f = -^-ytMs, t) ■ B{s, t)f + a„ {s)G{s, f, a, b) 
\ Ao(s) / Ao(s) 

(A.14) 
for any Hurwitz polynomial Aq(s) of order greater or equal to m, where 
G{s, f, a, b) is defined as 

G(s, /, a, b) = [gn, . . . ,gi,go],gj = -^Wjds) (^iWjbis)f){aibj + aibj 

j=0 

and Wjc, Wjb are strictly proper transfer functions that have the same 
poles as j^y 

Proof (i) From the definition of A(s, ^), A(s, i), 5(s, ^), B{s^ t)^ we have 

n m 

A{s, t){B{s, t)f) = Y,Y. ^^i^^h^'f) (A.15) 

i=0 j=0 
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n m 

Bis,t)iAis,t)f) = 5]5]5^(a,6,s7) (A.16) 

i=0 j=0 

Now we consider s^{aibjS^ f) and treat the three cases i > j, i < j and i = j 
separately: First, we suppose i > j and write 

s^a^bjs^f) = s^ {s'-^a,bjs^ f)) 

Using the identity s{aihjS^ f) = aibjS^^^ f + {ciihj + aihj)s^ f , where I is any integer, 
for i — j times, we can swap the operator s*^-' with aihj and obtain 

fe=i 
and, therefore, 

s\a,b,s^f) = s\a^bjs'f) + Y, s'-\a,bj + a,bj)s'-^+'' f, * > j (A.17) 

fe=i 

Similarly, for i < j, we write 

s^a^bjs^f) = s\{a,bjs'-')s'f) 

Now using aibjS^ f = s{aibj)s^^^ f — {hibj + aibj)s^^^ f, where I is any integer, for 
j — i times, we have 

{a,b,si-')s'f = s^'\a,b,)s'f - J^ s'-'^^a^b, + a,b,)s'~^+'' f 

fe=i 

and, therefore, 

s\a,b,s^f) = s\a,bjs'f) - ^ s''\a,b, + a,b,)s'~'+'' f, i < j (A.18) 

fc=i 

For i = j, it is obvious that 

s\a,b,.s3f) = s3{a,b,s'f), i = j (A.19) 

Combining (A.17), (A.18) and (A.19), we have 

n m 

A{s, t){B{s, t)f) = YY. ^'i^^b.s'f) + n = B{s, t){A{s, t)f) + n (A.20) 

i=0 j=0 
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where 

n m i—j n m j — i 

''I = E E E ^'"'(«*^- + «.6,)s-'"'+v - E E E ^'''i^^b, + a,b/)s'-'+''f 

i=0 i = o fe=l i=0 3=0 fc=l 

j<i j>i 

Note that for < i < n,0 < j < m and 1 < fc < |i — j|, we have 

j < i — k, j + k— l<i — I, ifi>J 
"i- ^ J ~ k, i + k— l<j — I, ifi<j 

Therefore all the s-terms in ri ( before and after the term dibj + aihj) have order 
less than max{n,m} — 1, and ri can be expressed as 

ri = al{s)F{a,b)an{s)f 

where n = max{ri, to} — 1 and F{a,b) G j^nxn ^^ ^ time-varying matrix whose 
elements are linear combinations of dibj + Uibj. Because a,b €i Coo, it follows from 
the definition of F{a, b) that 

\\F{a,b)\\ <ci|d| + C2|6| 
(ii) Applying Lemma A.l with W{s) = -r^-ri' ^^ have 

/ = T-TT"i^j/ - "^jciiWjbDiaibj + a,bj)) 



''Aois)' Ao(s) 

where Wjc{s),Wjb{s) are strictly proper transfer functions, which have the same 
poles as J— Tjy- Therefore 



A{s,t) (Bis,t)-^f) = EE-^' h^^i^ii/ 



Ao(s) / ^^^^ \ ' 'Ao(s)- 

n m i\j n m 

Y.Y.YT^M^=f) - 5]5]sW,,((W^,b/)(d.6, + aS,)) 



-A(s,t).B(s,f)/ + r2 (A.21) 



n ?n 

A 



Ao(s)' 
where 

^2 = - E E ■'*W^.c((W^,6/)(d^6, + a,b,)) 

i=0 j=0 

From the definition of r2, we can write 

r2 = 0^(5)0(5,/, 0,6) 
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by defining 

m 

G{sJ,a,b) = [gn,,---,9i,go], gj = -^Wjc{s) y{Wjbf){dibj + a,bj)j 

D 



B Optimization Techniques 

An important part of every adaptive control scheme is the on-hne estimator 
or adaptive law used to provide an estimate of the plant or controller param- 
eters at each time t. Most of these adaptive laws are derived by minimizing 
certain cost functions with respect to the estimated parameters. The type of 
the cost function and method of minimization determines the properties of 
the resulting adaptive law as well as the overall performance of the adaptive 
scheme. 

In this section we introduce some simple optimization techniques that 
include the method of steepest descent, referred to as the gradient method, 
Newton's method and the gradient projection method for constrained mini- 
mization problems. 

B.l Notation and Mathematical Background 

A real-valued function / : TZ" ^^ 7?. is said to be continuously differentiable 
if the partial derivatives l^^' , • " " ) q^ ^xist for each x £ 7Z"' and are con- 
tinuous functions of x. In this case, we write / e C^. More generally, we 
write / e C™ if all partial derivatives of order m exist and are continuous 
functions of x. 

If / e C^, the gradient of / at a point x £ TZ"' is defined to be the 
column vector 



V/(x) = 



dfjx) 
dxi 



dfix) 



dXn 

If / e C^, the Hessian of / at x is defined to be the symmetric nxn matrix 
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having d"^ f{x)/dxidxj as the ijth element, i.e., 



d'f{x) 



dxidyj 

A subset S of TZ" is said to be convex if for every x,y ^ S and a £ [0, 1], 
we have ax + (1 — a)y e S. 

A function f : S >-^ TZ is said to be convex over the convex set S if for 
every x,y ^ S and a G [0, 1] we have 

fiax + (1 - a)y) < af{x) + (1 - a)f{y) 

Let f E C^ over an open convex set S, then / is convex over S iff 

f{y)>f{x) + {Vf{x))'^{y-x), yx,yeS (B.l) 

If / e C^ over S and V^/(x) > Vx G 5, then / is convex over S. 

Let us now consider the following unconstrained minimization problem 

minimize J(9) . . 

subject to 6* e 7^" ^ ' ^ 

where J : 7?," i-^ 7?- is a given function. We say that the vector 9* is a global 
minimum for (B.2) if 

J (6*) < J (6) ye e w' 

A necessary and sufficient condition satisfied by the global minimum 9* is 
given by the following lemma. 

Lemma B.l Assume that J (^ C^ and is convex over TZ^. Then 9* is a 
global minimum for (B.2) iff 

VJ(r) = 

The proof of Lemma B.l can be found in [132, 196]. 

A vector 9 is called a regular point of the surface Sg = {9 ^ 7^" \g{9) = } 
if Vg(9) / 0. At a regular point ^, the set 

M{9) = {e e 7^" \e'^Vg{e) = 0} 

is called the tangent plane of g at 9. 
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B.2 The Method of Steepest Descent (Gradient Method) 

This is one of the oldest and most widely known methods for solving the 
unconstrained minimization problem (B.2). It is also one of the simplest for 
which a satisfactory analysis exists. More sophisticated methods are often 
motivated by an attempt to modify the basic steepest descent technique for 
better convergence properties [21, 132, 196]. The method of steepest descent 
proceeds from an initial approximation 6q for the minimum 9* to successive 
points 9i,62,- ■ • in 7?-" in an iterative manner until some stopping condition 
is satisfied. Given the current point 6^, the point 9k+i is obtained by a linear 
search in the direction d^ where 

4 = -VJ(0fc) 

It can be shown [196] that dk is the direction from 9^ in which the initial rate 
of decrease of J{9) is the greatest. Therefore, the sequence {9^} is defined 
by 

9k+i = ek + Xkdk = 9k-Xk^J{9k), {k = 0,1,2, ■■■) (B.3) 

where 9q is given and Xk , known as the step size or step length, is determined 
by the linear search method, so that 9k-\-i minimizes J{9) in the direction dk 
from 9k- A simpler expression for 6k+i can be obtained by setting Xk = X Vfc, 
i.e., 

9k+i = 9k- XVJ{9k) (B.4) 

In this case, the linear search for A^ is not required, though the choice of the 
step length A is a compromise between accuracy and efficiency. 

Considering infinitesimally small step lengths, (B.4) can be converted to 
the continuous-time diiferential equation 

e=-VJ{9{t)), 9{to) = 9o (B.5) 

whose solution 9(t) is the descent path in the time domain starting from 
t = to. 

The direction of steepest descent d = — V J can be scaled by a constant 
positive definite matrix T = T^ as follows: We let T = TiTj where Ti is an 
n X n nonsingular matrix and consider the vector 9 e TZ^ given by 

T^9 = 9 
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Then the minimization problem (B.2) is equivalent to 

(B.6) 



minimize J(6) = J(Ti(. 
subject to ^ e W 



If 9* is a minimum of J, the vector 6* = Ti6* is a minimum of J. The 
steepest descent for (B.6) is given by 

4+1 = 0k- AVJ(4) (B.7) 

Because V J(0) = ^^gi^ = TjVJ{e) and Ti^ = ^ it follows from (B.7) that 

Ok+i = ek- XFiFjV J{9k) 

Setting r = TiT^, we obtain the scaled version for the steepest descent 
algorithm 

4+1 = 4 - ArVJ(4) (B.8) 

The continuous-time version of (B.8) is now given by 

9 = -rVJ{9) (B.9) 

The convergence properties of (B.3), (B.4), (B.8) for different step lengths 
are given in any standard book on optimization such as [132, 196]. The 
algorithms (B.5), (B.9) for various cost functions J(9) are used in Chapters 4 
to 9 where the design and analysis of adaptive laws is considered. 

B.3 Newton's Method 

Let us consider the minimization problem (B.2) and assume that J (9) is con- 
vex over 7?.". Then according to Lemma B.l, any global minimum 9* should 
satisfy VJ(^*) = 0. Usually V J{9*) = gives a set of nonlinear algebraic 
equations whose solution 9* may be found by solving these equations using 
a series of successive approximations known as the Newton's method. 

Let 9k be the estimate of 9* at instant k. Then V J(^) for 9 close to 9k 
may be approximated by the linear portion of the Taylor's series expansion 

VJ{9) ~ VJ{9k) + ^ V J(^) \e=9, {9 -9k) (B.IO) 
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The estimate 0k+i of 9* at the k + 1 iteration can now be generated from 
(B.IO) by setting its right-hand side equal to zero and solving for 9 = 9k+i, 
i.e., 

9k+i = 9k-H-\9k)VJi9k), k = 0,1,2,... (B.ll) 

where H{9k) = -§fj^ J{(^k) = V^ J(0fc) is the Hessian matrix whose inverse is 
assumed to exist at each iteration k. 

A continuous time version of (B.ll) can also be developed by constructing 
a differential equation whose solution 9(t) converges to the root of V J(^) = 
as t ^ oo. Treating 9(t) as a smooth function of time we have 

|vj(^(f)) = ^VJ(^)^ = Hi9)9 (B.12) 

Choosing 

9 = -PH-^{9)VJ{e), e{to) = 9o (B.13) 

for some scalar /3 > 0, we have 

|vj(0(t)) = -pVJi9) 

or 

VJ(0(t)) = e-^(*-*'')VJ(6'o) (B.14) 

It is therefore clear that if a solution 9(t) of (B.13) exists Vt > Iq, then 
equation (B.14) implies that this solution will converge to a root of VJ = 
as t ^ oo. 

When the cost J depends explicitly on the time t, that is J = J(9, t) and 
is convex for each time t, then any global minimum 9* should satisfy 

VJ(r,t) = 0, Vt>to>0 

In this case, (B.12) becomes 

|VJ(«,*) = |,VJ(«,*)«+|VJ(M) 
Therefore, if we choose 

9 = -H-\9) UvJ{9, t) + ^yj{0. t)\ (B.15) 
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for some scalar /3 > 0, where H{6,t) = -^V J{9,t) we have 

jVj{e,t) = -(ivj{e,t) 



or 



VJ{6{t),t) = e-''^'-'"^VJ{e{to),to) (B.16) 



If (B.15) has a solution, then (B.16) implies that such solution will converge 
to a root of V J = as t ^ oo. 

Newton's method is very attractive in terms of its convergence properties, 
but suffers from the drawback of requiring the existence of the inverse of 
the Hessian matrix H(9) at each instant of time (k or t). It has to be 
modified in order to avoid the costly and often impractical evaluation of the 
inverse of H. Various modified Newton's methods use an approximation 
of the inverse Hessian. The form of the approximation ranges from the 
simplest where H~^ remains fixed throughout the iterative process, to the 
more advanced where improved approximations are obtained at each step 
on the basis of information gathered during the descent process [132]. It 
is worth mentioning that in contrast to the steepest descent method, the 
Newton's method is "scale free" in the sense that it cannot be affected by a 
change in the coordinate system. 

B.4 Gradient Projection Method 

In sections B.2 and B.3, the search for the minimum of the function J(6) 
given in (B.2) was carried out for all 9 £ TZ^\ In some cases, 6 is constrained 
to belong to a certain convex set 

s = {e e n"" \g(e) < 0} (b.i7) 

in TZ^ where g(-) is a scalar-valued function if there is only one constraint 
and a vector- valued function if there are more than one constraints. In this 
case, the search for the minimum is restricted to the convex set defined by 
(B.17) instead of 71". 

Let us first consider the simple case where we have an equality constraint, 
that is, we 

minimize J{0) 

subject to g{e) = ^ ^ ^ 
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where g(9) is a scalar-valued function. One of the most common techniques 
for handling constraints is to use a descent method in which the direction 
of descent is chosen to reduce the function J(9) by remaining within the 
constrained region. Such method is usually referred to as the gradient 
projection method. 

We start with a point ^o satisfying the constraint, i.e., g{6o) = 0. To 
obtain an improved vector 9i, we project the negative gradient of J at Oq 
i.e., -VJ(6'o) onto the tangent plane M(0o) = |6l e 71" Vfi('^((9o)6l = o} 
obtaining the direction vector Pr(0o)- Then 6i is taken as ^o + -^oPr(0o) 
where Aq is chosen to minimize J{9i). The general form of this iteration is 
given by 

Ok+i = 0fc + AfcPr(0fc) (B.19) 

where A^ is chosen to minimize J{9k) and Pr(0fc) is the new direction vector 
after projecting —VJ{9k) onto }A{9k). The explicit expression for Pr(^fc) can 
be obtained as follows: The vector —'S/J{9k) can be expressed as a linear 
combination of the vector Pr(0fc) and the normal vector N{9k) = ^ g{9k) to 
the tangent plane M{9k) at 9^-, i-e., 

-VJ{9k) = aVg{9k) + Pr(0fc) (B.20) 

for some constant a. Because Pi{9k) lies on the tangent plane Ai{9k), we 
also have \/g~^ {9k)PT{9k) = which together with (B.20) implies that 

-Vg'^VJ = aVg'^Vg 



I.e., 



a=-(V5^V<7)-'V<7^VJ 



Hence, from (B.20), we obtain 

Pr(^fc) = - [/ - Vg{Vg'^Vg)-^Vg'^] V J (B.21) 

We refer to Pr(0fc) as the projected direction onto the tangent plant Ai{9k)- 
The gradient projection method is illustrated in Figure B.l. 

It is clear from Figure B.l that when g(9) is not a linear function of 9, the 
new vector 0^+1 given by (B.19) may not satisfy the constraint, so it must 
be modified. There are several successive approximation techniques that can 
be employed to move 9k+i from M{9k) to the constraint surface g{9) = 
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VgOk) 



-VJOk) 



MOk) 




Figure B.l Gradient projection method. 



[132, 196]. One special case, which is often encountered in adaptive control 
applications, is when 9 is constrained to stay inside a ball with a given center 
and radius, i.e., g{9) = {9 — 9q)^ {9 — 6q) — M"^ where ^o is a fixed constant 
vector and M > is a scalar. In this case, the discrete projection algorithm 
which guarantees that 9^ ^ S \/k is 







\Sk+i—So\ 



if 14+1 -eo\<M 
M if 1^+1 - 6io| > M 



(B.22) 



Letting the step length Afc become infinitesimally small, we obtain the 
continuous-time version of (B.19), i.e.. 



e = Pr{9) 



lv7„T 



I-Vg{Vg'Vg)-'Vg' VJ 



(B.23) 



Because of the sufficiently small step length, the trajectory 9(t), if it exists, 
will satisfy g{9{t)) = Vt > provided ^(0) = 6*0 satisfies 5(6*0) = 0. 

The scaled version of the gradient projection method can be obtained by 
using the change of coordinates Ti9 = 9 where Fi is a nonsingular matrix 
that satisfies T = TiTj and T is the scaling positive definite constant matrix. 
Following a similar approach as in section B.2, the scaled version of (B.23) 
is given by 

9 = Pt{9) 
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where 

Pr{e) = - [/ - r\/g{Vg'^rVg)-^Vg'^] TV J (B.24) 

The niininiization problem (B.18) can now be extended to 



minimize J(9) 
subject to g{6) < 



(B.25) 



where S = {9 & TZ^ IffC^) < 0} is a convex subset of TZ'^. 

The solution to (B.25) follows directly from that of the unconstrained 
problem and (B.18). We start from an initial point ^o ^ 5. If the current 
point is in the interior of S, defined as Sq = {6 ^ TV^ |5(^) < 0}, then the 
unconstrained algorithm is used. If the current point is on the boundary of 
5, defined as 5{S) = {9 ^ TV^ \g{(^) = 0} and the direction of search given 
by the unconstrained algorithm is pointing away from 5, then we use the 
gradient projection algorithm. If the direction of search is pointing inside S 
then we keep the unconstrained algorithm. In view of the above, the solution 
to the constrained optimization problem (B.25) is given by 



VJ{9) if ^ e 5oor 9 e 5{S) and - VJ'^Vg < 

(B.26) 



- V J + |S?^ V J otherwise 



where ^(0) e 5 or with the scaling matrix 

' -VVJ{9) if0e5o 

e=\ or 6* e 5{S) and - iVVJ)'^Vg < 

-rVJ + r Jg^/J rVJ otherwise 

(B.27) 

B.5 Example 

Consider the scalar time varying equation 

y(t) = e*u{t) (B.28) 

where y,u : TZ'^ i-^ TZ are bounded uniformly continuous functions of time 
and 9* ^ 7Z \s a. constant. We would like to obtain an estimate of 9* at 
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each time t from the measurements of y^r), u(t), < t < t. Let 9(t) be the 
estimate of 9* at time t, then 

y{t) = e{t)u{t) 

is the estimate of y(t) at time t and 

e{t) = y - y = -{e{t) - 0*)u (B.29) 

is the resulting estimation error due to d(t) / 6*. We would like to generate 
a trajectory 6(t) so that e(t) -^ and 0(t) ^ 0* as t ^ oo by minimizing 
certain cost functions of e{t) w.r.t. 9{t). 

Let us first choose the simple quadratic cost 

J(e, t) = -e\t) = ^ ^ ^ (B.30) 

and minimize it w.r.t. 6. For each given t, J(^, t) is convex over 7?, and 
9 = 9* \s a minimum for all t > 0. J(9,t), however, can reach its minimum 
value, i.e., zero when 9^9*. 

The gradient and Hessian of J are 

VJ{9, t) = {9- r )n2(i) = -tu (B.31) 

VV(0, t) = H{9, t) = u^{t) > (B.32) 

Using the gradient method we have 

9 = 'yeu, 9(0) = 9o (B.33) 

for some 7 > 0. Using the Newton's method, i.e., (B.15), we obtain 



1 
~72 



-eu+—VJ 
ot 



^[u + 2u] (B.34) 



u 

which is valid provided n^ > and ii exists. 

For the sake of simplicity, let us assume that n^ > cq > for some con- 
stant Co and u G £00 and analyze (B.33), (B.34) using a Lyapunov function 
approach. 

We first consider (B.33) and choose the function 

V{9) = f (B.35) 

27 
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where 6(t) = 9{t) — 9* is the parameter error. Because 9* is a constant, we 
have 9 = 9 = 'jeu and from (B.29) e = —9u. Therefore, along any solution 
of (B.33) we have 

V = — = 9eu = -9^u'^ < -co9^ < 

7 

which implies that the equilibrium 9e = 0, i.e, 9e = 9* is e.s. 
Similarly, for (B.34) we choose 



Vi9) 



9\^ 



Because n^ is bounded from above and below by cq > 0, V(9) is positive 
definite, radially unbounded and decrescent. The time derivative V of V(9) 
along the solution of (B.34) is given by 

V = u*99 + 29^u^u = u^e9u + 2u^t9u + 29^u^u 

Using e = —9u we have 

V = -~9'^u^ - 29'^u^u + 2~9'^u^u = -9^u^ < -cl9^ 

which implies that the equilibrium 9e = i.e., 9e = 9* of (B.34) is e.s. 

Let us now assume that an upper bound for 9* is known, i.e., \9*\ < c for 
some constant c > 0. If instead of (B.30) we consider the minimization of 

J{9,t)=^-^^u^ 

subject to g{9) = 6*^ - c^ < 
the gradient projection algorithm will give us 

jeu if 9"^ < (? 

or if 9'^ = c^ and eu9 < (B.36) 

otherwise 

where 0(0) is chosen so that 0^(0) < (? . We analyze (B.36) by considering 
the function given by (B.35). Along the trajectory of (B.36), we have 

V = -~9'^u^ < -2-iCQV{9) if 0^ < (? or if 0^ = c^ and tu9 < 
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and 

V = Oi{e^ = c^ and eu9 > 0. 

Now 6*2 = c^ and en^ > ^ 69* > c^. Since \6*\ < c and 6'^ = c^, the 
inequality 66* > c^ is not possible which implies that for 6^ = c^ , eu6 < 
and no switching takes place in (B.36). Hence, 

V{6) < -2-fcoV{d) Vt > 

i.e., V{d) and therefore 6 converges exponentially to zero. 
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